2024-05-09T12:09:13.569 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T12:09:13.569 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569 --name teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} --verbose -- /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/orig.config.yaml 2024-05-09T12:09:13.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T12:09:13.689 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569 branch: main description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7699569' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: e789e13b84d622c44a76f34b06dedf79bf4b7d36 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mds.a - mgr.x - osd.0 - osd.1 - - mon.b - mds.b - mon.c - mgr.y - osd.2 - osd.3 - - client.0 seed: 8443 sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e sleep_before_teardown: 0 subset: 0/1 suite: smoke suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_e789e13b84d622c44a76f34b06dedf79bf4b7d36/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e789e13b84d622c44a76f34b06dedf79bf4b7d36 targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFuFHqjlS7YAd2Q4X3ptBhIQHwOydAho8SsW6KVQTme7/BoWEKkR2HWjog9UbMTt/p1ZoJDXqdKCorZ/83SWfY= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuE9iU8mBVHjV/kH4tblm3t1lpvvC2yP8JFaa/tkNIn056DncEY/OYPENma1LQRISV8xlYBVljZjzVVOFD1s5A= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLed1qIXjNc/XYNe/rcTHQJM5AAF18EONemkWFaxwK14QIRS4sHuIzP0cUnX6A0PfB1GMALrsCwhkm3v5wrhGYw= tasks: - install: cleanup: true - ceph: log-ignorelist: - \(POOL_APP_NOT_ENABLED\) - ceph-fuse: null - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_05:00:13 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T12:09:13.690 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e789e13b84d622c44a76f34b06dedf79bf4b7d36/qa; will attempt to use it 2024-05-09T12:09:13.690 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e789e13b84d622c44a76f34b06dedf79bf4b7d36/qa/tasks 2024-05-09T12:09:13.690 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T12:09:13.692 INFO:teuthology.task.internal:Checking packages... 2024-05-09T12:09:13.716 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e' 2024-05-09T12:09:13.717 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T12:09:13.717 INFO:teuthology.packaging:ref: None 2024-05-09T12:09:13.717 INFO:teuthology.packaging:tag: None 2024-05-09T12:09:13.717 INFO:teuthology.packaging:branch: main 2024-05-09T12:09:13.717 INFO:teuthology.packaging:sha1: 720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:09:13.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-05-09T12:09:14.054 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3575.g720f8e95 2024-05-09T12:09:14.055 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T12:09:14.061 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T12:09:14.061 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T12:09:14.076 INFO:teuthology.task.internal:Saving configuration 2024-05-09T12:09:14.091 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T12:09:14.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T12:09:14.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 12:03:52.094959', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFuFHqjlS7YAd2Q4X3ptBhIQHwOydAho8SsW6KVQTme7/BoWEKkR2HWjog9UbMTt/p1ZoJDXqdKCorZ/83SWfY='} 2024-05-09T12:09:14.144 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 12:03:52.093692', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuE9iU8mBVHjV/kH4tblm3t1lpvvC2yP8JFaa/tkNIn056DncEY/OYPENma1LQRISV8xlYBVljZjzVVOFD1s5A='} 2024-05-09T12:09:14.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 12:03:52.092085', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLed1qIXjNc/XYNe/rcTHQJM5AAF18EONemkWFaxwK14QIRS4sHuIzP0cUnX6A0PfB1GMALrsCwhkm3v5wrhGYw='} 2024-05-09T12:09:14.166 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T12:09:14.173 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'] 2024-05-09T12:09:14.173 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'] 2024-05-09T12:09:14.173 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['client.0'] 2024-05-09T12:09:14.173 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T12:09:14.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a8c16ce50>, signals=[15]) 2024-05-09T12:09:14.299 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T12:09:14.305 INFO:teuthology.task.internal:Opening connections... 2024-05-09T12:09:14.305 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:09:14.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:09:14.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:09:14.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:09:14.511 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-05-09T12:09:14.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:09:14.640 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T12:09:14.646 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-09T12:09:14.665 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-09T12:09:14.666 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-09T12:09:14.723 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-05-09T12:09:14.723 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-05-09T12:09:14.723 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T12:09:14.724 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T12:09:14.725 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-09T12:09:14.750 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-05-09T12:09:14.769 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-05-09T12:09:14.769 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-05-09T12:09:14.826 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-05-09T12:09:14.826 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-05-09T12:09:14.826 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T12:09:14.827 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T12:09:14.828 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-05-09T12:09:14.863 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-05-09T12:09:14.883 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-05-09T12:09:14.883 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-05-09T12:09:14.940 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-05-09T12:09:14.941 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T12:09:14.941 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-05-09T12:09:14.941 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T12:09:14.941 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T12:09:14.941 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T12:09:14.941 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-05-09T12:09:14.958 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T12:09:14.966 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T12:09:14.976 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T12:09:14.976 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-09T12:09:14.979 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-05-09T12:09:14.981 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-05-09T12:09:14.997 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T12:09:15.006 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T12:09:15.006 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-09T12:09:15.036 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-05-09T12:09:15.039 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-05-09T12:09:15.125 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T12:09:15.204 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T12:09:15.220 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T12:09:15.221 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T12:09:15.221 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T12:09:15.222 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T12:09:15.222 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T12:09:15.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:09:15.239 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-05-09T12:09:15.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:09:15.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:09:15.240 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-05-09T12:09:15.241 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-09T12:09:15.297 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-437.el9.x86_64 2024-05-09T12:09:15.297 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-437.el9.x86_64 2024-05-09T12:09:15.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-05-09T12:09:15.300 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-437.el9.x86_64 2024-05-09T12:09:15.300 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-437.el9.x86_64 2024-05-09T12:09:15.301 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.14.0-437.el9.x86_64 2024-05-09T12:09:15.301 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2024-05-09T12:09:15.301 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-437.el9.x86_64 2024-05-09T12:09:15.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-05-09T12:09:17.641 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-09T12:09:18.249 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.1 MB 00:01 2024-05-09T12:09:18.540 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.1 MB 00:01 2024-05-09T12:09:20.424 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-09T12:09:21.025 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-05-09T12:09:22.058 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-05-09T12:09:25.358 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-05-09T12:09:26.401 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-05-09T12:09:26.967 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-09T12:09:28.069 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-05-09T12:09:28.359 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.2 MB 00:03 2024-05-09T12:09:29.223 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-05-09T12:09:30.159 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-09T12:09:31.261 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-09T12:09:32.171 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 21 MB 00:05 2024-05-09T12:09:34.404 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-09T12:09:36.410 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-09T12:09:36.444 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T12:09:36.444 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T12:09:36.529 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:09:36.542 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-05-09T12:09:36.543 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:09:36.543 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 78 M 2024-05-09T12:09:36.543 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 123 M 2024-05-09T12:09:36.543 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:09:36.939 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.8 MB/s | 484 kB 00:00 2024-05-09T12:09:37.526 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-09T12:09:38.056 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 11 MB/s | 15 MB 00:01 2024-05-09T12:09:38.425 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T12:09:38.426 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T12:09:38.521 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:09:38.536 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:09:38.536 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-05-09T12:09:38.536 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-05-09T12:09:38.537 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:09:38.538 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 78 M 2024-05-09T12:09:38.538 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 123 M 2024-05-09T12:09:38.538 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:09:38.631 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 17 MB/s | 28 MB 00:01 2024-05-09T12:09:38.670 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.9 MB/s | 484 kB 00:00 2024-05-09T12:09:38.948 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-05-09T12:09:38.949 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:09:38.949 INFO:teuthology.orchestra.run.smithi135.stdout:Total 32 MB/s | 78 MB 00:02 2024-05-09T12:09:39.263 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-05-09T12:09:39.523 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T12:09:39.524 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T12:09:39.610 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:09:39.622 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout:Install 4 Packages 2024-05-09T12:09:39.623 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:09:39.624 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 78 M 2024-05-09T12:09:39.624 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 123 M 2024-05-09T12:09:39.624 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:09:39.626 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:09:39.713 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 30 MB/s | 34 MB 00:01 2024-05-09T12:09:39.965 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:09:39.965 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:09:39.985 INFO:teuthology.orchestra.run.smithi188.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 5.4 MB/s | 484 kB 00:00 2024-05-09T12:09:40.021 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 21 MB/s | 28 MB 00:01 2024-05-09T12:09:40.021 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:09:40.021 INFO:teuthology.orchestra.run.smithi160.stdout:Total 52 MB/s | 78 MB 00:01 2024-05-09T12:09:40.369 INFO:teuthology.orchestra.run.smithi188.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 33 MB/s | 15 MB 00:00 2024-05-09T12:09:40.700 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:09:40.919 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:09:40.920 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:09:40.994 INFO:teuthology.orchestra.run.smithi188.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 31 MB/s | 34 MB 00:01 2024-05-09T12:09:41.043 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:09:41.043 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:09:41.353 INFO:teuthology.orchestra.run.smithi188.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 20 MB/s | 28 MB 00:01 2024-05-09T12:09:41.353 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:09:41.353 INFO:teuthology.orchestra.run.smithi188.stdout:Total 45 MB/s | 78 MB 00:01 2024-05-09T12:09:41.983 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:09:41.984 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:09:42.029 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:09:42.366 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:09:42.367 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:09:43.294 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:09:43.294 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:09:43.329 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:09:44.044 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:09:44.129 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:44.397 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:09:45.064 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:09:45.146 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:45.694 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:09:46.311 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:09:46.395 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:46.786 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:46.934 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:47.837 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:47.981 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:49.054 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:09:49.201 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:51.660 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:51.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:09:52.674 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:52.717 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:09:53.901 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:09:53.961 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:09:56.477 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:09:57.421 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:09:58.687 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:26.348 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:26.386 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:10:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:10:26.802 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:10:26.828 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:26.872 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.176 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:10:27.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:10:27.176 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.643 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.644 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:10:27.644 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:10:27.850 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.889 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.984 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:27.984 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:10:27.985 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:10:27.985 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.985 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.985 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.985 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:27.986 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:10:27.986 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:10:27.992 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:28.071 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:28.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.072 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.072 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T12:10:28.072 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T12:10:28.072 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T12:10:28.072 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T12:10:28.072 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:28.122 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:28.123 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-05-09T12:10:28.155 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-05-09T12:10:28.155 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-05-09T12:10:28.155 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-05-09T12:10:28.156 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 68.el9 2024-05-09T12:10:28.156 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-05-09T12:10:28.156 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T12:10:28.156 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-05-09T12:10:28.156 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8264254 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T12:10:28.157 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:10:28.158 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T12:10:28.160 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T12:10:28.160 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T12:10:28.241 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:28.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T12:10:28.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T12:10:28.242 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T12:10:28.327 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:28.403 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:28.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.404 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.404 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T12:10:28.404 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T12:10:28.404 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T12:10:28.404 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T12:10:28.404 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:28.453 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:28.453 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 68.el9 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T12:10:28.484 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8264254 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T12:10:28.485 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T12:10:28.486 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-05-09T12:10:28.486 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:10:28.486 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T12:10:28.486 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T12:10:28.487 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-444.el9.x86_64 2024-05-09T12:10:28.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T12:10:28.831 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-05-09T12:10:29.093 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-05-09T12:10:29.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:10:29.119 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:10:29.465 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:29.535 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.535 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:29.535 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T12:10:29.536 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T12:10:29.536 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T12:10:29.536 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-09T12:10:29.536 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T12:10:29.536 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T12:10:29.585 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T12:10:29.585 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T12:10:29.585 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 68.el9 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8264254 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T12:10:29.623 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:10:29.624 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T12:10:29.625 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T12:10:29.625 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 5.14.0-444.el9.x86_64 2024-05-09T12:10:29.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T12:10:30.242 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T12:10:30.277 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-05-09T12:10:30.279 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-09T12:10:30.293 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-05-09T12:10:30.298 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.WQpo6nH3yv 2024-05-09T12:10:30.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WQpo6nH3yv 2024-05-09T12:10:30.372 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.WQpo6nH3yv 2024-05-09T12:10:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T12:10:30.459 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-05-09T12:10:30.462 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-05-09T12:10:30.477 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.UNLCgOSahb 2024-05-09T12:10:30.478 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UNLCgOSahb 2024-05-09T12:10:30.524 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.WQpo6nH3yv is 6KB 2024-05-09T12:10:30.543 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.UNLCgOSahb 2024-05-09T12:10:30.572 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.WQpo6nH3yv 2024-05-09T12:10:30.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T12:10:30.648 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T12:10:30.648 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T12:10:30.649 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T12:10:30.649 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T12:10:30.651 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T12:10:30.681 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.UNLCgOSahb is 6KB 2024-05-09T12:10:30.730 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.UNLCgOSahb 2024-05-09T12:10:30.745 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T12:10:30.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-05-09T12:10:30.806 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T12:10:30.806 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T12:10:30.806 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T12:10:30.807 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T12:10:30.808 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T12:10:30.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-05-09T12:10:31.805 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T12:10:31.833 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-05-09T12:10:31.835 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-05-09T12:10:31.855 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.OpktmW44OB 2024-05-09T12:10:31.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OpktmW44OB 2024-05-09T12:10:31.928 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.OpktmW44OB 2024-05-09T12:10:32.074 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.OpktmW44OB is 6KB 2024-05-09T12:10:32.122 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.OpktmW44OB 2024-05-09T12:10:32.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T12:10:32.221 INFO:teuthology.orchestra.run.smithi188.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T12:10:32.221 INFO:teuthology.orchestra.run.smithi188.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T12:10:32.221 INFO:teuthology.orchestra.run.smithi188.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T12:10:32.221 INFO:teuthology.orchestra.run.smithi188.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T12:10:32.222 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T12:10:32.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-05-09T12:11:00.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T12:11:00.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:11:00.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:00.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T12:11:00.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:11:00.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:02.377 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-09T12:11:02.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:11:02.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:19.199 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-09T12:11:19.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-05-09T12:11:20.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-05-09T12:11:28.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:11:28.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:28.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:11:28.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:29.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:11:29.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:31.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-09T12:11:31.518 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-05-09T12:11:32.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-05-09T12:11:43.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:11:43.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:43.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:11:43.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:44.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:11:44.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:11:47.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-05-09T12:12:01.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-05-09T12:12:02.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:12:02.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:12:05.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-05-09T12:12:15.162 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-09T12:12:15.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:12:15.533 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T12:12:15.533 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-09T12:12:15.548 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-444.el9.x86_64 2024-05-09T12:12:15.548 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T12:12:15.548 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T12:12:15.548 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T12:12:16.549 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T12:12:16.549 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T12:12:16.620 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-05-09T12:12:16.658 DEBUG:teuthology.parallel:result is None 2024-05-09T12:12:16.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:12:16.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:12:20.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-05-09T12:12:23.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:12:23.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:12:38.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:12:38.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:12:38.426 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-09T12:12:38.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:12:38.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T12:12:38.822 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-05-09T12:12:38.838 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-444.el9.x86_64 2024-05-09T12:12:38.839 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T12:12:38.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T12:12:38.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T12:12:39.840 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T12:12:39.840 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T12:12:39.916 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-05-09T12:12:39.963 DEBUG:teuthology.parallel:result is None 2024-05-09T12:12:42.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-05-09T12:13:03.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:13:03.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:13:03.673 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-05-09T12:13:04.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:13:04.003 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-09T12:13:04.003 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-05-09T12:13:04.018 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-444.el9.x86_64 2024-05-09T12:13:04.019 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T12:13:04.019 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T12:13:04.019 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T12:13:05.019 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-05-09T12:13:05.019 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T12:13:05.094 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-05-09T12:13:05.128 DEBUG:teuthology.parallel:result is None 2024-05-09T12:13:05.131 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T12:13:05.138 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T12:13:05.139 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T12:13:05.142 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T12:13:05.145 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T12:13:05.163 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T12:13:05.169 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T12:13:05.178 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T12:13:05.178 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T12:13:05.202 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T12:13:05.204 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T12:13:05.337 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T12:13:05.344 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T12:13:05.344 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T12:13:05.346 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T12:13:05.349 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T12:13:05.378 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.383 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.384 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.390 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.395 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.397 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T12:13:05.398 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T12:13:05.406 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T12:13:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T12:13:05.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T12:13:05.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T12:13:05.469 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T12:13:05.478 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T12:13:05.478 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T12:13:05.504 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T12:13:05.510 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T12:13:05.528 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:05.603 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:05.655 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:05.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:05.783 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:13:05.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T12:13:05.849 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:05.894 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:05.940 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:06.022 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:06.065 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:13:06.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T12:13:06.130 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:06.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T12:13:06.226 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:06.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T12:13:06.359 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:13:06.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T12:13:06.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-09T12:13:06.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-05-09T12:13:06.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-05-09T12:13:06.470 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:13:06.481 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:13:06.509 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:13:07.023 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T12:13:07.030 INFO:teuthology.task.internal:Starting timer... 2024-05-09T12:13:07.031 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T12:13:07.040 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T12:13:07.048 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-09T12:13:07.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-09T12:13:07.113 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-09T12:13:07.115 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-05-09T12:13:07.176 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-05-09T12:13:07.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-05-09T12:13:07.242 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-05-09T12:13:07.243 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T12:13:07.243 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-09T12:13:07.282 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-09T12:13:07.282 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-05-09T12:13:07.376 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-05-09T12:13:07.377 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-05-09T12:13:07.414 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-05-09T12:13:07.415 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-05-09T12:13:07.415 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:13:07.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:13:07.446 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:13:07.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:13:07.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:13:07.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:13:07.503 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T12:13:07.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-09T12:13:07.538 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-05-09T12:13:07.563 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-05-09T12:13:07.591 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T12:13:07.601 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T12:13:07.607 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T12:13:07.755 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T12:13:07.777 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T12:13:07.778 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi160.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T12:17:12.085 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-05-09T12:17:12.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:17:12.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:17:12.165 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-09T12:17:12.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-09T12:17:12.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:17:12.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:17:12.317 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-09T12:17:12.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-09T12:17:12.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:17:12.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T12:17:12.484 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-05-09T12:17:12.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-05-09T12:17:12.568 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T12:17:12.579 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T12:17:12.579 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T12:17:12.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:17:12.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T12:17:12.582 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:17:12.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T12:17:12.585 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:17:12.613 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T12:17:12.614 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T12:17:12.628 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T12:17:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T12:17:12.639 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T12:17:12.654 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-05-09T12:17:12.654 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T12:17:12.656 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-09T12:17:12.665 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-05-09T12:17:12.668 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-09T12:17:12.680 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T12:17:12.681 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-05-09T12:17:12.683 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T12:17:12.692 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-05-09T12:17:12.694 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T12:17:12.697 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T12:17:12.707 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T12:17:12.721 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T12:17:12.750 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.761 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.782 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:17:12.790 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:17:12.790 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-05-09T12:17:12.790 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.790 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.790 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.791 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:17:12.791 INFO:teuthology.run_tasks:Running task install... 2024-05-09T12:17:12.799 DEBUG:teuthology.task.install:project ceph 2024-05-09T12:17:12.799 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}} 2024-05-09T12:17:12.799 DEBUG:teuthology.task.install:config {'cleanup': True, 'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'} 2024-05-09T12:17:12.799 INFO:teuthology.task.install:Using flavor: default 2024-05-09T12:17:12.805 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T12:17:12.805 INFO:teuthology.task.install:extra packages: [] 2024-05-09T12:17:12.806 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T12:17:12.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:17:12.808 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T12:17:12.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:17:12.809 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'tag': None, 'wait_for_package': False} 2024-05-09T12:17:12.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:17:12.954 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/ 2024-05-09T12:17:12.954 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3575.g720f8e95 2024-05-09T12:17:13.026 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/ 2024-05-09T12:17:13.027 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3575.g720f8e95 2024-05-09T12:17:13.036 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/ 2024-05-09T12:17:13.037 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3575.g720f8e95 2024-05-09T12:17:13.077 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T12:17:13.077 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:17:13.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T12:17:13.103 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T12:17:13.103 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T12:17:13.146 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T12:17:13.146 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:17:13.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T12:17:13.169 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T12:17:13.174 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T12:17:13.174 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T12:17:13.200 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T12:17:13.200 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:17:13.200 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T12:17:13.226 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-09T12:17:13.227 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/720f8e954cd9c4d6163a1fee379f1c286b4f5c7e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T12:17:13.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T12:17:13.243 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:17:13.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T12:17:13.307 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-09T12:17:13.309 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-09T12:17:13.317 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:17:13.371 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:17:13.382 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-05-09T12:17:13.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-05-09T12:17:13.435 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-05-09T12:17:13.437 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-05-09T12:17:13.539 INFO:teuthology.orchestra.run.smithi135.stdout:54 files removed 2024-05-09T12:17:13.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw 2024-05-09T12:17:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:54 files removed 2024-05-09T12:17:13.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw 2024-05-09T12:17:13.666 INFO:teuthology.orchestra.run.smithi160.stdout:54 files removed 2024-05-09T12:17:13.693 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw 2024-05-09T12:17:14.246 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 206 kB/s | 84 kB 00:00 2024-05-09T12:17:14.358 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 217 kB/s | 84 kB 00:00 2024-05-09T12:17:14.365 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 186 kB/s | 84 kB 00:00 2024-05-09T12:17:14.682 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-05-09T12:17:14.697 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-05-09T12:17:14.725 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-05-09T12:17:15.065 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-05-09T12:17:15.100 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-09T12:17:15.134 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-05-09T12:17:15.776 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-09T12:17:17.074 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.1 MB 00:01 2024-05-09T12:17:19.474 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.1 MB 00:04 2024-05-09T12:17:20.303 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 19 MB 00:03 2024-05-09T12:17:21.383 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-05-09T12:17:23.891 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-05-09T12:17:26.227 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-09T12:17:27.009 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-09T12:17:27.795 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-05-09T12:17:28.601 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-05-09T12:17:29.803 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-09T12:17:30.174 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 21 MB 00:02 2024-05-09T12:17:30.276 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-05-09T12:17:31.727 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-09T12:17:32.804 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-09T12:17:34.878 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-09T12:17:35.472 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 6.9 kB/s | 1.7 kB 00:00 2024-05-09T12:17:37.252 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 11 M 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.4 M 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:17:37.268 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 21 M 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 25 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 747 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 501 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:37.269 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 45 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 135 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 161 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 321 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 300 k 2024-05-09T12:17:37.270 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 100 k 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout:Install 30 Packages 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 2 Packages 2024-05-09T12:17:37.271 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:17:37.272 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 60 M 2024-05-09T12:17:37.272 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:17:37.830 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:17:37.842 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:17:37.842 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 11 M 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.4 M 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 21 M 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 25 k 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T12:17:37.843 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 747 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 501 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 45 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 135 k 2024-05-09T12:17:37.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 161 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 321 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 300 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 100 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:17:37.845 INFO:teuthology.orchestra.run.smithi160.stdout:Install 30 Packages 2024-05-09T12:17:37.846 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 2 Packages 2024-05-09T12:17:37.846 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:17:37.846 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 60 M 2024-05-09T12:17:37.846 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:17:38.046 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-09T12:17:38.787 INFO:teuthology.orchestra.run.smithi188.stdout:(1/32): ceph-base-19.0.0-3575.g720f8e95.el9.x86 6.2 MB/s | 5.4 MB 00:00 2024-05-09T12:17:38.830 INFO:teuthology.orchestra.run.smithi188.stdout:(2/32): ceph-selinux-19.0.0-3575.g720f8e95.el9. 608 kB/s | 25 kB 00:00 2024-05-09T12:17:39.013 INFO:teuthology.orchestra.run.smithi188.stdout:(3/32): ceph-radosgw-19.0.0-3575.g720f8e95.el9. 9.7 MB/s | 11 MB 00:01 2024-05-09T12:17:39.046 INFO:teuthology.orchestra.run.smithi188.stdout:(4/32): libcephfs2-19.0.0-3575.g720f8e95.el9.x8 3.4 MB/s | 747 kB 00:00 2024-05-09T12:17:39.097 INFO:teuthology.orchestra.run.smithi188.stdout:(5/32): libradosstriper1-19.0.0-3575.g720f8e95. 5.9 MB/s | 501 kB 00:00 2024-05-09T12:17:39.181 INFO:teuthology.orchestra.run.smithi188.stdout:(6/32): python3-ceph-argparse-19.0.0-3575.g720f 541 kB/s | 45 kB 00:00 2024-05-09T12:17:39.273 INFO:teuthology.orchestra.run.smithi188.stdout:(7/32): python3-ceph-common-19.0.0-3575.g720f8e 1.4 MB/s | 135 kB 00:00 2024-05-09T12:17:39.373 INFO:teuthology.orchestra.run.smithi188.stdout:(8/32): python3-cephfs-19.0.0-3575.g720f8e95.el 1.6 MB/s | 161 kB 00:00 2024-05-09T12:17:39.473 INFO:teuthology.orchestra.run.smithi188.stdout:(9/32): python3-rados-19.0.0-3575.g720f8e95.el9 3.1 MB/s | 321 kB 00:00 2024-05-09T12:17:39.565 INFO:teuthology.orchestra.run.smithi188.stdout:(10/32): librgw2-19.0.0-3575.g720f8e95.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-05-09T12:17:39.591 INFO:teuthology.orchestra.run.smithi188.stdout:(11/32): python3-rbd-19.0.0-3575.g720f8e95.el9. 2.5 MB/s | 300 kB 00:00 2024-05-09T12:17:39.633 INFO:teuthology.orchestra.run.smithi188.stdout:(12/32): python3-rgw-19.0.0-3575.g720f8e95.el9. 1.5 MB/s | 100 kB 00:00 2024-05-09T12:17:40.150 INFO:teuthology.orchestra.run.smithi188.stdout:(13/32): ceph-common-19.0.0-3575.g720f8e95.el9. 9.5 MB/s | 21 MB 00:02 2024-05-09T12:17:40.414 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 11 M 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.4 M 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:17:40.425 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 21 M 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 25 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 747 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T12:17:40.426 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 501 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 5.4 M 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 45 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 135 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 161 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 321 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 300 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 100 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T12:17:40.427 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout:Install 30 Packages 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-05-09T12:17:40.428 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:17:40.429 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 60 M 2024-05-09T12:17:40.429 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:17:40.483 INFO:teuthology.orchestra.run.smithi188.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 120 kB/s | 107 kB 00:00 2024-05-09T12:17:40.600 INFO:teuthology.orchestra.run.smithi188.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 166 kB/s | 160 kB 00:00 2024-05-09T12:17:40.783 INFO:teuthology.orchestra.run.smithi188.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-05-09T12:17:40.806 INFO:teuthology.orchestra.run.smithi160.stdout:(1/32): ceph-base-19.0.0-3575.g720f8e95.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-05-09T12:17:40.873 INFO:teuthology.orchestra.run.smithi160.stdout:(2/32): ceph-selinux-19.0.0-3575.g720f8e95.el9. 378 kB/s | 25 kB 00:00 2024-05-09T12:17:41.015 INFO:teuthology.orchestra.run.smithi160.stdout:(3/32): libcephfs2-19.0.0-3575.g720f8e95.el9.x8 5.1 MB/s | 747 kB 00:00 2024-05-09T12:17:41.174 INFO:teuthology.orchestra.run.smithi160.stdout:(4/32): libradosstriper1-19.0.0-3575.g720f8e95. 3.1 MB/s | 501 kB 00:00 2024-05-09T12:17:41.409 INFO:teuthology.orchestra.run.smithi188.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 717 kB/s | 662 kB 00:00 2024-05-09T12:17:41.426 INFO:teuthology.orchestra.run.smithi188.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 66 kB/s | 42 kB 00:00 2024-05-09T12:17:41.451 INFO:teuthology.orchestra.run.smithi188.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-05-09T12:17:41.532 INFO:teuthology.orchestra.run.smithi160.stdout:(5/32): ceph-radosgw-19.0.0-3575.g720f8e95.el9. 3.5 MB/s | 11 MB 00:02 2024-05-09T12:17:41.608 INFO:teuthology.orchestra.run.smithi160.stdout:(6/32): python3-ceph-argparse-19.0.0-3575.g720f 604 kB/s | 45 kB 00:00 2024-05-09T12:17:41.691 INFO:teuthology.orchestra.run.smithi160.stdout:(7/32): python3-ceph-common-19.0.0-3575.g720f8e 1.6 MB/s | 135 kB 00:00 2024-05-09T12:17:41.800 INFO:teuthology.orchestra.run.smithi160.stdout:(8/32): librgw2-19.0.0-3575.g720f8e95.el9.x86_6 8.6 MB/s | 5.4 MB 00:00 2024-05-09T12:17:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:(9/32): python3-cephfs-19.0.0-3575.g720f8e95.el 1.2 MB/s | 161 kB 00:00 2024-05-09T12:17:41.867 INFO:teuthology.orchestra.run.smithi160.stdout:(10/32): python3-rados-19.0.0-3575.g720f8e95.el 4.7 MB/s | 321 kB 00:00 2024-05-09T12:17:41.901 INFO:teuthology.orchestra.run.smithi160.stdout:(11/32): python3-rbd-19.0.0-3575.g720f8e95.el9. 3.9 MB/s | 300 kB 00:00 2024-05-09T12:17:41.926 INFO:teuthology.orchestra.run.smithi160.stdout:(12/32): python3-rgw-19.0.0-3575.g720f8e95.el9. 1.7 MB/s | 100 kB 00:00 2024-05-09T12:17:42.043 INFO:teuthology.orchestra.run.smithi188.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 58 kB/s | 36 kB 00:00 2024-05-09T12:17:42.085 INFO:teuthology.orchestra.run.smithi188.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-05-09T12:17:42.227 INFO:teuthology.orchestra.run.smithi188.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 270 kB/s | 221 kB 00:00 2024-05-09T12:17:42.335 INFO:teuthology.orchestra.run.smithi160.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 246 kB/s | 107 kB 00:00 2024-05-09T12:17:42.360 INFO:teuthology.orchestra.run.smithi160.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 369 kB/s | 160 kB 00:00 2024-05-09T12:17:42.435 INFO:teuthology.orchestra.run.smithi160.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-05-09T12:17:42.677 INFO:teuthology.orchestra.run.smithi188.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 58 kB/s | 26 kB 00:00 2024-05-09T12:17:42.702 INFO:teuthology.orchestra.run.smithi160.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-05-09T12:17:42.728 INFO:teuthology.orchestra.run.smithi160.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-05-09T12:17:42.752 INFO:teuthology.orchestra.run.smithi188.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 436 kB/s | 309 kB 00:00 2024-05-09T12:17:42.931 INFO:teuthology.orchestra.run.smithi135.stdout:(1/32): ceph-radosgw-19.0.0-3575.g720f8e95.el9. 5.3 MB/s | 11 MB 00:01 2024-05-09T12:17:42.947 INFO:teuthology.orchestra.run.smithi160.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 172 kB/s | 42 kB 00:00 2024-05-09T12:17:42.978 INFO:teuthology.orchestra.run.smithi160.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 881 kB/s | 221 kB 00:00 2024-05-09T12:17:42.981 INFO:teuthology.orchestra.run.smithi135.stdout:(2/32): ceph-selinux-19.0.0-3575.g720f8e95.el9. 504 kB/s | 25 kB 00:00 2024-05-09T12:17:43.054 INFO:teuthology.orchestra.run.smithi160.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 339 kB/s | 36 kB 00:00 2024-05-09T12:17:43.079 INFO:teuthology.orchestra.run.smithi160.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-05-09T12:17:43.111 INFO:teuthology.orchestra.run.smithi188.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 112 kB/s | 49 kB 00:00 2024-05-09T12:17:43.128 INFO:teuthology.orchestra.run.smithi188.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 179 kB/s | 67 kB 00:00 2024-05-09T12:17:43.157 INFO:teuthology.orchestra.run.smithi135.stdout:(3/32): ceph-base-19.0.0-3575.g720f8e95.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-05-09T12:17:43.241 INFO:teuthology.orchestra.run.smithi135.stdout:(4/32): libcephfs2-19.0.0-3575.g720f8e95.el9.x8 2.8 MB/s | 747 kB 00:00 2024-05-09T12:17:43.300 INFO:teuthology.orchestra.run.smithi135.stdout:(5/32): libradosstriper1-19.0.0-3575.g720f8e95. 3.4 MB/s | 501 kB 00:00 2024-05-09T12:17:43.378 INFO:teuthology.orchestra.run.smithi188.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-05-09T12:17:43.379 INFO:teuthology.orchestra.run.smithi160.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 950 kB/s | 309 kB 00:00 2024-05-09T12:17:43.400 INFO:teuthology.orchestra.run.smithi135.stdout:(6/32): python3-ceph-argparse-19.0.0-3575.g720f 452 kB/s | 45 kB 00:00 2024-05-09T12:17:43.421 INFO:teuthology.orchestra.run.smithi160.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 623 kB/s | 26 kB 00:00 2024-05-09T12:17:43.479 INFO:teuthology.orchestra.run.smithi160.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 836 kB/s | 49 kB 00:00 2024-05-09T12:17:43.538 INFO:teuthology.orchestra.run.smithi160.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-09T12:17:43.553 INFO:teuthology.orchestra.run.smithi188.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 451 kB/s | 192 kB 00:00 2024-05-09T12:17:43.709 INFO:teuthology.orchestra.run.smithi135.stdout:(7/32): ceph-common-19.0.0-3575.g720f8e95.el9.x 7.6 MB/s | 21 MB 00:02 2024-05-09T12:17:43.734 INFO:teuthology.orchestra.run.smithi135.stdout:(8/32): python3-ceph-common-19.0.0-3575.g720f8e 406 kB/s | 135 kB 00:00 2024-05-09T12:17:43.793 INFO:teuthology.orchestra.run.smithi135.stdout:(9/32): python3-cephfs-19.0.0-3575.g720f8e95.el 1.9 MB/s | 161 kB 00:00 2024-05-09T12:17:43.878 INFO:teuthology.orchestra.run.smithi188.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-05-09T12:17:43.901 INFO:teuthology.orchestra.run.smithi135.stdout:(10/32): librgw2-19.0.0-3575.g720f8e95.el9.x86_ 8.1 MB/s | 5.4 MB 00:00 2024-05-09T12:17:43.927 INFO:teuthology.orchestra.run.smithi135.stdout:(11/32): python3-rados-19.0.0-3575.g720f8e95.el 1.6 MB/s | 321 kB 00:00 2024-05-09T12:17:43.952 INFO:teuthology.orchestra.run.smithi135.stdout:(12/32): python3-rbd-19.0.0-3575.g720f8e95.el9. 1.8 MB/s | 300 kB 00:00 2024-05-09T12:17:43.953 INFO:teuthology.orchestra.run.smithi188.stdout:(30/32): librados2-19.0.0-3575.g720f8e95.el9.x8 8.5 MB/s | 3.4 MB 00:00 2024-05-09T12:17:43.978 INFO:teuthology.orchestra.run.smithi135.stdout:(13/32): python3-rgw-19.0.0-3575.g720f8e95.el9. 1.3 MB/s | 100 kB 00:00 2024-05-09T12:17:44.012 INFO:teuthology.orchestra.run.smithi188.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-05-09T12:17:44.072 INFO:teuthology.orchestra.run.smithi160.stdout:(26/32): ceph-common-19.0.0-3575.g720f8e95.el9. 3.8 MB/s | 21 MB 00:05 2024-05-09T12:17:44.095 INFO:teuthology.orchestra.run.smithi135.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-05-09T12:17:44.105 INFO:teuthology.orchestra.run.smithi160.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.4 MB/s | 839 kB 00:00 2024-05-09T12:17:44.120 INFO:teuthology.orchestra.run.smithi135.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 555 kB/s | 107 kB 00:00 2024-05-09T12:17:44.137 INFO:teuthology.orchestra.run.smithi135.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 869 kB/s | 160 kB 00:00 2024-05-09T12:17:44.179 INFO:teuthology.orchestra.run.smithi188.stdout:(32/32): librbd1-19.0.0-3575.g720f8e95.el9.x86_ 10 MB/s | 3.1 MB 00:00 2024-05-09T12:17:44.184 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:17:44.184 INFO:teuthology.orchestra.run.smithi188.stdout:Total 8.7 MB/s | 60 MB 00:06 2024-05-09T12:17:44.187 INFO:teuthology.orchestra.run.smithi135.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-05-09T12:17:44.213 INFO:teuthology.orchestra.run.smithi135.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-05-09T12:17:44.238 INFO:teuthology.orchestra.run.smithi135.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-05-09T12:17:44.263 INFO:teuthology.orchestra.run.smithi135.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.8 MB/s | 221 kB 00:00 2024-05-09T12:17:44.283 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:17:44.289 INFO:teuthology.orchestra.run.smithi135.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 473 kB/s | 36 kB 00:00 2024-05-09T12:17:44.315 INFO:teuthology.orchestra.run.smithi160.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 793 kB/s | 192 kB 00:00 2024-05-09T12:17:44.315 INFO:teuthology.orchestra.run.smithi135.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-05-09T12:17:44.320 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:17:44.320 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:17:44.573 INFO:teuthology.orchestra.run.smithi135.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 100 kB/s | 26 kB 00:00 2024-05-09T12:17:44.690 INFO:teuthology.orchestra.run.smithi135.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-05-09T12:17:44.715 INFO:teuthology.orchestra.run.smithi135.stdout:(25/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 684 kB/s | 309 kB 00:00 2024-05-09T12:17:44.764 INFO:teuthology.orchestra.run.smithi160.stdout:(29/32): librados2-19.0.0-3575.g720f8e95.el9.x8 7.6 MB/s | 3.4 MB 00:00 2024-05-09T12:17:44.782 INFO:teuthology.orchestra.run.smithi135.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-05-09T12:17:44.856 INFO:teuthology.orchestra.run.smithi160.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-05-09T12:17:44.916 INFO:teuthology.orchestra.run.smithi135.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-09T12:17:44.950 INFO:teuthology.orchestra.run.smithi135.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-09T12:17:44.955 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:17:44.955 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:17:45.081 INFO:teuthology.orchestra.run.smithi160.stdout:(31/32): librbd1-19.0.0-3575.g720f8e95.el9.x86_ 9.9 MB/s | 3.1 MB 00:00 2024-05-09T12:17:45.100 INFO:teuthology.orchestra.run.smithi135.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-05-09T12:17:45.150 INFO:teuthology.orchestra.run.smithi135.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-05-09T12:17:45.351 INFO:teuthology.orchestra.run.smithi135.stdout:(31/32): librbd1-19.0.0-3575.g720f8e95.el9.x86_ 13 MB/s | 3.1 MB 00:00 2024-05-09T12:17:45.356 INFO:teuthology.orchestra.run.smithi160.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-05-09T12:17:45.362 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:17:45.363 INFO:teuthology.orchestra.run.smithi160.stdout:Total 8.0 MB/s | 60 MB 00:07 2024-05-09T12:17:45.470 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:17:45.507 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:17:45.507 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:17:45.634 INFO:teuthology.orchestra.run.smithi135.stdout:(32/32): librados2-19.0.0-3575.g720f8e95.el9.x8 5.0 MB/s | 3.4 MB 00:00 2024-05-09T12:17:45.638 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:17:45.638 INFO:teuthology.orchestra.run.smithi135.stdout:Total 12 MB/s | 60 MB 00:05 2024-05-09T12:17:45.736 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:17:45.771 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:17:45.771 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:17:46.141 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:17:46.142 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:17:46.367 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:17:46.403 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:17:46.403 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:17:46.459 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-09T12:17:46.493 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-09T12:17:46.518 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-09T12:17:46.540 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:46.564 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:46.759 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:47.205 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-09T12:17:47.253 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:47.337 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:47.425 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 8/34 2024-05-09T12:17:47.455 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:47.510 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:47.538 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-09T12:17:47.556 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:17:47.584 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 11/34 2024-05-09T12:17:47.641 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-09T12:17:47.670 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-09T12:17:47.683 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:17:47.695 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-09T12:17:47.716 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:47.726 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:47.749 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:47.775 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:17:47.809 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-09T12:17:47.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-09T12:17:47.918 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-09T12:17:47.936 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:47.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-09T12:17:47.949 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-09T12:17:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-09T12:17:47.990 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-09T12:17:47.991 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:48.005 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:48.022 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-09T12:17:48.035 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-09T12:17:48.051 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-09T12:17:48.084 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-09T12:17:48.224 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:48.286 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-09T12:17:48.385 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-09T12:17:48.419 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-09T12:17:48.438 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:48.456 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:48.515 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:48.546 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:48.576 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 23/34 2024-05-09T12:17:48.604 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 8/34 2024-05-09T12:17:48.613 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-09T12:17:48.648 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:48.680 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-09T12:17:48.711 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:48.727 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:48.749 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-09T12:17:48.793 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 11/34 2024-05-09T12:17:48.816 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:17:48.862 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:17:48.884 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:48.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 8/34 2024-05-09T12:17:48.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:48.950 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:48.982 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-09T12:17:49.001 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 9/34 2024-05-09T12:17:49.038 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-09T12:17:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 11/34 2024-05-09T12:17:49.092 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-09T12:17:49.098 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-09T12:17:49.125 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:49.125 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-09T12:17:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:17:49.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-09T12:17:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:49.196 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:49.198 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-09T12:17:49.227 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-09T12:17:49.229 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 13/34 2024-05-09T12:17:49.260 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-09T12:17:49.263 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-09T12:17:49.273 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 27/34 2024-05-09T12:17:49.303 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 28/34 2024-05-09T12:17:49.380 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-09T12:17:49.415 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-09T12:17:49.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-09T12:17:49.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-09T12:17:49.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-09T12:17:49.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-09T12:17:49.579 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-09T12:17:49.623 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:49.714 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:49.744 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 23/34 2024-05-09T12:17:49.781 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-09T12:17:49.874 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-09T12:17:49.914 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:50.022 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 22/34 2024-05-09T12:17:50.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 23/34 2024-05-09T12:17:50.089 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-09T12:17:50.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-09T12:17:50.301 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:50.380 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:50.450 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 27/34 2024-05-09T12:17:50.478 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 28/34 2024-05-09T12:17:50.569 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-09T12:17:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:50.681 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 26/34 2024-05-09T12:17:50.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 27/34 2024-05-09T12:17:50.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 28/34 2024-05-09T12:17:51.589 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:51.624 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:52.192 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:52.244 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:52.348 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:52.348 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T12:17:52.349 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T12:17:52.349 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:17:52.380 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:17:52.769 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:52.816 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:53.095 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:53.128 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:53.391 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:53.429 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:53.521 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:53.521 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T12:17:53.521 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T12:17:53.521 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:17:53.563 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:17:53.690 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 29/34 2024-05-09T12:17:53.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:53.827 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 30/34 2024-05-09T12:17:53.827 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T12:17:53.828 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T12:17:53.828 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:17:53.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:02.098 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-05-09T12:18:02.099 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:03.099 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-05-09T12:18:03.117 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-05-09T12:18:03.118 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-05-09T12:18:03.118 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-05-09T12:18:03.118 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:03.125 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:03.125 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:03.125 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:18:03.125 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:03.125 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:03.126 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:03.127 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:03.218 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:03.219 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-09T12:18:03.570 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-05-09T12:18:03.571 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-09T12:18:03.571 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:04.063 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:04.086 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:04.086 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:04.086 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:18:04.089 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:04.089 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:04.089 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:04.090 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:04.174 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:04.174 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 1/34 2024-05-09T12:18:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2/34 2024-05-09T12:18:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 3/34 2024-05-09T12:18:04.367 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 4/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 6/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 8/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 9/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 10/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 11/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 13/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-09T12:18:04.368 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:04.369 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-09T12:18:04.370 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 33/34 2024-05-09T12:18:04.545 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 32/34 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T12:18:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-09T12:18:04.657 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:05.312 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:05.312 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:05.312 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-05-09T12:18:05.313 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.313 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.313 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:05.313 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:18:05.313 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:18:05.314 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:18:05.315 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.315 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:18:05.315 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:18:05.315 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.316 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:18:05.317 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:18:05.318 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:18:05.318 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:18:05.318 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:18:05.318 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:05.318 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:05.436 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 1/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 3/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 4/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 6/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 8/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 9/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 10/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 11/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 13/34 2024-05-09T12:18:05.437 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-09T12:18:05.438 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-09T12:18:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-09T12:18:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-09T12:18:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-09T12:18:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 33/34 2024-05-09T12:18:05.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-test 2024-05-09T12:18:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 1/34 2024-05-09T12:18:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2/34 2024-05-09T12:18:05.869 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 3/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 4/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_6 6/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 7/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9. 8/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x8 9/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 10/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 11/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 12/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 13/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-09T12:18:05.870 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-09T12:18:05.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-09T12:18:05.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 33/34 2024-05-09T12:18:06.260 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:32 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 49 M 2024-05-09T12:18:06.382 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 163 k 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout:Install 4 Packages 2024-05-09T12:18:06.383 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:06.384 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 50 M 2024-05-09T12:18:06.384 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 211 M 2024-05-09T12:18:06.384 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:18:06.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.387 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:18:06.388 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:18:06.389 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:06.389 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.631 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:18:06.632 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:18:06.633 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:18:06.634 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:06.634 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:06.735 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-test 2024-05-09T12:18:06.857 INFO:teuthology.orchestra.run.smithi188.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-09T12:18:06.908 INFO:teuthology.orchestra.run.smithi188.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-09T12:18:07.020 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-test 2024-05-09T12:18:07.024 INFO:teuthology.orchestra.run.smithi188.stdout:(3/4): libcephsqlite-19.0.0-3575.g720f8e95.el9. 447 kB/s | 163 kB 00:00 2024-05-09T12:18:07.307 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:32 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:07.430 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:07.431 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:07.431 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:18:07.431 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:07.431 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:07.431 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 49 M 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 163 k 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-05-09T12:18:07.432 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:07.433 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 50 M 2024-05-09T12:18:07.433 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 211 M 2024-05-09T12:18:07.433 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:07.594 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:29 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 49 M 2024-05-09T12:18:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 163 k 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-05-09T12:18:07.716 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:07.717 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 50 M 2024-05-09T12:18:07.717 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 211 M 2024-05-09T12:18:07.717 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:07.910 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-09T12:18:07.931 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): libcephsqlite-19.0.0-3575.g720f8e95.el9. 718 kB/s | 163 kB 00:00 2024-05-09T12:18:07.956 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-09T12:18:08.207 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): libcephsqlite-19.0.0-3575.g720f8e95.el9. 745 kB/s | 163 kB 00:00 2024-05-09T12:18:08.249 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-05-09T12:18:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 364 kB/s | 64 kB 00:00 2024-05-09T12:18:11.749 INFO:teuthology.orchestra.run.smithi188.stdout:(4/4): ceph-test-19.0.0-3575.g720f8e95.el9.x86_ 9.7 MB/s | 49 MB 00:05 2024-05-09T12:18:11.751 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:11.751 INFO:teuthology.orchestra.run.smithi188.stdout:Total 9.2 MB/s | 50 MB 00:05 2024-05-09T12:18:11.778 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:11.799 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:11.799 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:12.170 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:12.170 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:12.683 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): ceph-test-19.0.0-3575.g720f8e95.el9.x86_ 10 MB/s | 49 MB 00:04 2024-05-09T12:18:12.685 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:12.685 INFO:teuthology.orchestra.run.smithi135.stdout:Total 10 MB/s | 50 MB 00:04 2024-05-09T12:18:12.712 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:12.728 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:12.820 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T12:18:12.866 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T12:18:12.893 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:13.105 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:13.105 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:13.638 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:13.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T12:18:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T12:18:13.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:15.848 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): ceph-test-19.0.0-3575.g720f8e95.el9.x86_ 6.0 MB/s | 49 MB 00:08 2024-05-09T12:18:15.849 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:15.850 INFO:teuthology.orchestra.run.smithi160.stdout:Total 5.9 MB/s | 50 MB 00:08 2024-05-09T12:18:15.875 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:15.894 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:15.894 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:16.266 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:16.266 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:16.799 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:16.882 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-09T12:18:16.923 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-09T12:18:16.950 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:17.573 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:17.650 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:18.434 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:18.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:20.085 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:20.086 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/4 2024-05-09T12:18:20.086 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2/4 2024-05-09T12:18:20.086 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T12:18:20.357 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T12:18:20.357 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:18:20.358 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:20.359 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:20.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph 2024-05-09T12:18:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/4 2024-05-09T12:18:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2/4 2024-05-09T12:18:20.945 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T12:18:21.189 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:47 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:21.247 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T12:18:21.247 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:21.247 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:21.247 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:21.247 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:21.248 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:18:21.248 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:18:21.248 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:21.248 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:21.313 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:21.315 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 6.6 k 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 2.4 M 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 1.5 M 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 274 k 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 4.7 M 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 17 M 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T12:18:21.316 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T12:18:21.317 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T12:18:21.318 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout:Install 36 Packages 2024-05-09T12:18:21.319 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:21.320 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 30 M 2024-05-09T12:18:21.320 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 108 M 2024-05-09T12:18:21.320 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:21.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph 2024-05-09T12:18:21.621 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 3/4 2024-05-09T12:18:21.706 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:21.919 INFO:teuthology.orchestra.run.smithi188.stdout:(1/36): ceph-19.0.0-3575.g720f8e95.el9.x86_64.r 40 kB/s | 6.6 kB 00:00 2024-05-09T12:18:22.093 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:44 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:22.218 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:22.221 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:22.221 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:18:22.221 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:22.221 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 6.6 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 2.4 M 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 1.5 M 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 274 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 4.7 M 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 17 M 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T12:18:22.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T12:18:22.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:22.224 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:22.225 INFO:teuthology.orchestra.run.smithi135.stdout:Install 36 Packages 2024-05-09T12:18:22.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:22.225 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 30 M 2024-05-09T12:18:22.225 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 108 M 2024-05-09T12:18:22.225 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:22.644 INFO:teuthology.orchestra.run.smithi188.stdout:(2/36): ceph-mds-19.0.0-3575.g720f8e95.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-05-09T12:18:22.974 INFO:teuthology.orchestra.run.smithi135.stdout:(1/36): ceph-19.0.0-3575.g720f8e95.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-05-09T12:18:23.020 INFO:teuthology.orchestra.run.smithi188.stdout:(3/36): ceph-mon-19.0.0-3575.g720f8e95.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-05-09T12:18:23.086 INFO:teuthology.orchestra.run.smithi188.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3575.g720f 4.0 MB/s | 274 kB 00:00 2024-05-09T12:18:23.278 INFO:teuthology.orchestra.run.smithi188.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-09T12:18:23.370 INFO:teuthology.orchestra.run.smithi188.stdout:(6/36): ceph-mgr-19.0.0-3575.g720f8e95.el9.x86_ 959 kB/s | 1.5 MB 00:01 2024-05-09T12:18:23.412 INFO:teuthology.orchestra.run.smithi188.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 9.2 MB/s | 1.2 MB 00:00 2024-05-09T12:18:23.463 INFO:teuthology.orchestra.run.smithi188.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-05-09T12:18:23.475 INFO:teuthology.orchestra.run.smithi135.stdout:(2/36): ceph-mgr-19.0.0-3575.g720f8e95.el9.x86_ 2.0 MB/s | 1.5 MB 00:00 2024-05-09T12:18:23.513 INFO:teuthology.orchestra.run.smithi188.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-05-09T12:18:23.538 INFO:teuthology.orchestra.run.smithi188.stdout:(10/36): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2024-05-09T12:18:23.563 INFO:teuthology.orchestra.run.smithi188.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-05-09T12:18:23.642 INFO:teuthology.orchestra.run.smithi135.stdout:(3/36): ceph-mds-19.0.0-3575.g720f8e95.el9.x86_ 2.6 MB/s | 2.4 MB 00:00 2024-05-09T12:18:23.709 INFO:teuthology.orchestra.run.smithi135.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3575.g720f 4.0 MB/s | 274 kB 00:00 2024-05-09T12:18:24.048 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 4/4 2024-05-09T12:18:24.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/4 2024-05-09T12:18:24.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2/4 2024-05-09T12:18:24.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:24.328 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:24.334 INFO:teuthology.orchestra.run.smithi135.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 405 kB/s | 253 kB 00:00 2024-05-09T12:18:24.355 INFO:teuthology.orchestra.run.smithi188.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 231 kB/s | 188 kB 00:00 2024-05-09T12:18:24.390 INFO:teuthology.orchestra.run.smithi188.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 208 kB/s | 172 kB 00:00 2024-05-09T12:18:24.593 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph 2024-05-09T12:18:24.776 INFO:teuthology.orchestra.run.smithi135.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 2.8 MB/s | 1.2 MB 00:00 2024-05-09T12:18:24.898 INFO:teuthology.orchestra.run.smithi188.stdout:(14/36): ceph-osd-19.0.0-3575.g720f8e95.el9.x86 7.5 MB/s | 17 MB 00:02 2024-05-09T12:18:24.969 INFO:teuthology.orchestra.run.smithi135.stdout:(7/36): ceph-osd-19.0.0-3575.g720f8e95.el9.x86_ 11 MB/s | 17 MB 00:01 2024-05-09T12:18:24.994 INFO:teuthology.orchestra.run.smithi135.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-05-09T12:18:25.102 INFO:teuthology.orchestra.run.smithi135.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-05-09T12:18:25.125 INFO:teuthology.orchestra.run.smithi188.stdout:(15/36): python3-markupsafe-1.1.1-12.el9.x86_64 45 kB/s | 35 kB 00:00 2024-05-09T12:18:25.163 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:50 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:25.211 INFO:teuthology.orchestra.run.smithi135.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-05-09T12:18:25.231 INFO:teuthology.orchestra.run.smithi188.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-05-09T12:18:25.256 INFO:teuthology.orchestra.run.smithi188.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 59 kB/s | 51 kB 00:00 2024-05-09T12:18:25.287 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:25.289 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 6.6 k 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 2.4 M 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 1.5 M 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 274 k 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 4.7 M 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 17 M 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T12:18:25.290 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T12:18:25.291 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T12:18:25.292 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout:Install 36 Packages 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:25.293 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 30 M 2024-05-09T12:18:25.294 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 108 M 2024-05-09T12:18:25.294 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:25.294 INFO:teuthology.orchestra.run.smithi135.stdout:(11/36): ceph-mon-19.0.0-3575.g720f8e95.el9.x86 2.0 MB/s | 4.7 MB 00:02 2024-05-09T12:18:25.353 INFO:teuthology.orchestra.run.smithi135.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-05-09T12:18:25.379 INFO:teuthology.orchestra.run.smithi135.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-09T12:18:25.421 INFO:teuthology.orchestra.run.smithi135.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 518 kB/s | 35 kB 00:00 2024-05-09T12:18:25.446 INFO:teuthology.orchestra.run.smithi135.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-05-09T12:18:25.496 INFO:teuthology.orchestra.run.smithi135.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-05-09T12:18:25.522 INFO:teuthology.orchestra.run.smithi135.stdout:(17/36): python3-pycparser-2.20-6.el9.noarch.rp 244 kB/s | 135 kB 00:00 2024-05-09T12:18:25.564 INFO:teuthology.orchestra.run.smithi135.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-05-09T12:18:25.565 INFO:teuthology.orchestra.run.smithi188.stdout:(18/36): python3-toml-0.10.2-6.el9.noarch.rpm 62 kB/s | 42 kB 00:00 2024-05-09T12:18:25.632 INFO:teuthology.orchestra.run.smithi188.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 116 kB/s | 43 kB 00:00 2024-05-09T12:18:25.722 INFO:teuthology.orchestra.run.smithi135.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 274 kB/s | 43 kB 00:00 2024-05-09T12:18:25.789 INFO:teuthology.orchestra.run.smithi135.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 517 kB/s | 151 kB 00:00 2024-05-09T12:18:25.799 INFO:teuthology.orchestra.run.smithi188.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 267 kB/s | 151 kB 00:00 2024-05-09T12:18:25.815 INFO:teuthology.orchestra.run.smithi135.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 686 kB/s | 172 kB 00:00 2024-05-09T12:18:25.865 INFO:teuthology.orchestra.run.smithi135.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 141 kB/s | 11 kB 00:00 2024-05-09T12:18:25.890 INFO:teuthology.orchestra.run.smithi135.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-05-09T12:18:25.933 INFO:teuthology.orchestra.run.smithi188.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 80 kB/s | 11 kB 00:00 2024-05-09T12:18:25.957 INFO:teuthology.orchestra.run.smithi135.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-05-09T12:18:25.983 INFO:teuthology.orchestra.run.smithi135.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-05-09T12:18:26.008 INFO:teuthology.orchestra.run.smithi135.stdout:(26/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-05-09T12:18:26.042 INFO:teuthology.orchestra.run.smithi135.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 233 kB/s | 20 kB 00:00 2024-05-09T12:18:26.066 INFO:teuthology.orchestra.run.smithi188.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 132 kB/s | 18 kB 00:00 2024-05-09T12:18:26.067 INFO:teuthology.orchestra.run.smithi160.stdout:(1/36): ceph-19.0.0-3575.g720f8e95.el9.x86_64.r 23 kB/s | 6.6 kB 00:00 2024-05-09T12:18:26.067 INFO:teuthology.orchestra.run.smithi135.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 549 kB/s | 46 kB 00:00 2024-05-09T12:18:26.092 INFO:teuthology.orchestra.run.smithi188.stdout:(23/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 327 kB/s | 172 kB 00:00 2024-05-09T12:18:26.109 INFO:teuthology.orchestra.run.smithi135.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 781 kB/s | 79 kB 00:00 2024-05-09T12:18:26.126 INFO:teuthology.orchestra.run.smithi135.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-05-09T12:18:26.160 INFO:teuthology.orchestra.run.smithi135.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-09T12:18:26.185 INFO:teuthology.orchestra.run.smithi135.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-05-09T12:18:26.192 INFO:teuthology.orchestra.run.smithi188.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 641 kB/s | 358 kB 00:00 2024-05-09T12:18:26.209 INFO:teuthology.orchestra.run.smithi188.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 163 kB/s | 23 kB 00:00 2024-05-09T12:18:26.211 INFO:teuthology.orchestra.run.smithi135.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 425 kB/s | 36 kB 00:00 2024-05-09T12:18:26.225 INFO:teuthology.orchestra.run.smithi188.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 145 kB/s | 19 kB 00:00 2024-05-09T12:18:26.236 INFO:teuthology.orchestra.run.smithi135.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-09T12:18:26.261 INFO:teuthology.orchestra.run.smithi135.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-05-09T12:18:26.309 INFO:teuthology.orchestra.run.smithi160.stdout:(2/36): ceph-mgr-19.0.0-3575.g720f8e95.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-05-09T12:18:26.309 INFO:teuthology.orchestra.run.smithi188.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-05-09T12:18:26.311 INFO:teuthology.orchestra.run.smithi135.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-05-09T12:18:26.314 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:26.314 INFO:teuthology.orchestra.run.smithi135.stdout:Total 7.4 MB/s | 30 MB 00:04 2024-05-09T12:18:26.334 INFO:teuthology.orchestra.run.smithi188.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 369 kB/s | 46 kB 00:00 2024-05-09T12:18:26.427 INFO:teuthology.orchestra.run.smithi188.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 393 kB/s | 79 kB 00:00 2024-05-09T12:18:26.443 INFO:teuthology.orchestra.run.smithi188.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-05-09T12:18:26.459 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:26.498 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:26.498 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:26.569 INFO:teuthology.orchestra.run.smithi188.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 286 kB/s | 36 kB 00:00 2024-05-09T12:18:26.627 INFO:teuthology.orchestra.run.smithi188.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 449 kB/s | 90 kB 00:00 2024-05-09T12:18:26.669 INFO:teuthology.orchestra.run.smithi188.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 757 kB/s | 272 kB 00:00 2024-05-09T12:18:26.770 INFO:teuthology.orchestra.run.smithi188.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-05-09T12:18:26.793 INFO:teuthology.orchestra.run.smithi160.stdout:(3/36): ceph-mds-19.0.0-3575.g720f8e95.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-05-09T12:18:26.803 INFO:teuthology.orchestra.run.smithi188.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 981 kB/s | 230 kB 00:00 2024-05-09T12:18:26.901 INFO:teuthology.orchestra.run.smithi160.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3575.g720f 2.5 MB/s | 274 kB 00:00 2024-05-09T12:18:26.917 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:26.918 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:26.962 INFO:teuthology.orchestra.run.smithi188.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.2 MB/s | 427 kB 00:00 2024-05-09T12:18:26.965 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:26.965 INFO:teuthology.orchestra.run.smithi188.stdout:Total 5.3 MB/s | 30 MB 00:05 2024-05-09T12:18:27.111 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:27.152 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:27.152 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:27.426 INFO:teuthology.orchestra.run.smithi160.stdout:(5/36): ceph-osd-19.0.0-3575.g720f8e95.el9.x86_ 15 MB/s | 17 MB 00:01 2024-05-09T12:18:27.501 INFO:teuthology.orchestra.run.smithi160.stdout:(6/36): ceph-mon-19.0.0-3575.g720f8e95.el9.x86_ 3.3 MB/s | 4.7 MB 00:01 2024-05-09T12:18:27.581 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:27.582 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:27.843 INFO:teuthology.orchestra.run.smithi160.stdout:(7/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 269 kB/s | 253 kB 00:00 2024-05-09T12:18:28.198 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:28.260 INFO:teuthology.orchestra.run.smithi160.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 140 kB/s | 106 kB 00:00 2024-05-09T12:18:28.273 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-09T12:18:28.314 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-09T12:18:28.350 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-09T12:18:28.421 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-09T12:18:28.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-09T12:18:28.492 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-09T12:18:28.511 INFO:teuthology.orchestra.run.smithi160.stdout:(9/36): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-05-09T12:18:28.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-09T12:18:28.644 INFO:teuthology.orchestra.run.smithi160.stdout:(10/36): python3-pycparser-2.20-6.el9.noarch.rp 169 kB/s | 135 kB 00:00 2024-05-09T12:18:28.661 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-09T12:18:28.711 INFO:teuthology.orchestra.run.smithi160.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-09T12:18:28.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-09T12:18:28.747 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-09T12:18:28.776 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-09T12:18:28.778 INFO:teuthology.orchestra.run.smithi160.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-09T12:18:28.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-09T12:18:28.820 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:28.844 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-09T12:18:28.853 INFO:teuthology.orchestra.run.smithi160.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 464 kB/s | 35 kB 00:00 2024-05-09T12:18:28.873 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-09T12:18:28.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-09T12:18:28.905 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-09T12:18:28.911 INFO:teuthology.orchestra.run.smithi160.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-05-09T12:18:28.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-09T12:18:28.933 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-09T12:18:28.963 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-09T12:18:28.970 INFO:teuthology.orchestra.run.smithi160.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 716 kB/s | 42 kB 00:00 2024-05-09T12:18:29.004 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-09T12:18:29.010 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-09T12:18:29.020 INFO:teuthology.orchestra.run.smithi160.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 448 kB/s | 22 kB 00:00 2024-05-09T12:18:29.041 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-09T12:18:29.073 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-09T12:18:29.083 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-09T12:18:29.112 INFO:teuthology.orchestra.run.smithi160.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 147 kB/s | 125 kB 00:00 2024-05-09T12:18:29.166 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-09T12:18:29.230 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-09T12:18:29.243 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-09T12:18:29.263 INFO:teuthology.orchestra.run.smithi160.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 624 kB/s | 151 kB 00:00 2024-05-09T12:18:29.284 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-09T12:18:29.296 INFO:teuthology.orchestra.run.smithi160.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 237 kB/s | 43 kB 00:00 2024-05-09T12:18:29.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-09T12:18:29.320 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-09T12:18:29.349 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-09T12:18:29.364 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-09T12:18:29.371 INFO:teuthology.orchestra.run.smithi160.stdout:(20/36): python3-urllib3-1.26.5-5.el9.noarch.rp 257 kB/s | 215 kB 00:00 2024-05-09T12:18:29.384 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-09T12:18:29.397 INFO:teuthology.orchestra.run.smithi160.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-09T12:18:29.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-09T12:18:29.418 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-09T12:18:29.439 INFO:teuthology.orchestra.run.smithi160.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-05-09T12:18:29.460 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-09T12:18:29.466 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-09T12:18:29.500 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-09T12:18:29.505 INFO:teuthology.orchestra.run.smithi160.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-05-09T12:18:29.529 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-09T12:18:29.531 INFO:teuthology.orchestra.run.smithi160.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-05-09T12:18:29.535 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-09T12:18:29.565 INFO:teuthology.orchestra.run.smithi160.stdout:(25/36): python3-jaraco-classes-3.2.1-5.el9.noa 105 kB/s | 18 kB 00:00 2024-05-09T12:18:29.574 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-09T12:18:29.590 INFO:teuthology.orchestra.run.smithi160.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-05-09T12:18:29.615 INFO:teuthology.orchestra.run.smithi160.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-05-09T12:18:29.657 INFO:teuthology.orchestra.run.smithi160.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-05-09T12:18:29.661 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-09T12:18:29.682 INFO:teuthology.orchestra.run.smithi160.stdout:(29/36): python3-logutils-0.3.5-21.el9.noarch.r 394 kB/s | 46 kB 00:00 2024-05-09T12:18:29.724 INFO:teuthology.orchestra.run.smithi160.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-05-09T12:18:29.725 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-09T12:18:29.750 INFO:teuthology.orchestra.run.smithi160.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2024-05-09T12:18:29.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-09T12:18:29.791 INFO:teuthology.orchestra.run.smithi160.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 827 kB/s | 90 kB 00:00 2024-05-09T12:18:29.810 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-09T12:18:29.817 INFO:teuthology.orchestra.run.smithi160.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 389 kB/s | 36 kB 00:00 2024-05-09T12:18:29.852 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-09T12:18:29.858 INFO:teuthology.orchestra.run.smithi160.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-09T12:18:29.884 INFO:teuthology.orchestra.run.smithi160.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-05-09T12:18:29.890 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-09T12:18:29.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-09T12:18:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-09T12:18:29.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-09T12:18:29.984 INFO:teuthology.orchestra.run.smithi160.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.2 MB/s | 427 kB 00:00 2024-05-09T12:18:29.987 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:29.987 INFO:teuthology.orchestra.run.smithi160.stdout:Total 6.4 MB/s | 30 MB 00:04 2024-05-09T12:18:29.989 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-09T12:18:30.038 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-09T12:18:30.101 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-09T12:18:30.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-09T12:18:30.133 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:30.174 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:30.174 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:30.272 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 31/36 2024-05-09T12:18:30.297 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-09T12:18:30.302 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:30.330 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:30.344 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-09T12:18:30.414 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-09T12:18:30.501 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-09T12:18:30.543 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-09T12:18:30.632 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:30.632 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:30.668 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-09T12:18:30.843 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 31/36 2024-05-09T12:18:30.871 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:30.897 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:30.897 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:30.897 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:18:30.897 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:30.897 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:30.898 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:31.778 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:31.806 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:31.806 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:31.807 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:18:31.807 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:31.807 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:31.807 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:31.886 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:31.937 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-09T12:18:31.969 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-09T12:18:31.997 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-09T12:18:32.069 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-09T12:18:32.121 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-09T12:18:32.154 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-09T12:18:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-09T12:18:32.271 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:32.295 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:32.317 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-09T12:18:32.338 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:32.366 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:32.367 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:32.400 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-09T12:18:32.430 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-09T12:18:32.465 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-09T12:18:32.498 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-09T12:18:32.522 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:32.538 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:32.546 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:32.582 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-09T12:18:32.611 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:32.616 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-09T12:18:32.662 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-09T12:18:32.737 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-09T12:18:32.814 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:32.837 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:32.838 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:32.876 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-09T12:18:32.963 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-09T12:18:33.015 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-09T12:18:33.053 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-09T12:18:33.064 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:33.088 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:33.089 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:33.089 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:18:33.089 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:33.089 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:33.089 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:33.103 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-09T12:18:33.153 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:33.165 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-09T12:18:33.368 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-09T12:18:33.416 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-09T12:18:33.494 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-09T12:18:33.583 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-09T12:18:33.623 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-09T12:18:33.758 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-09T12:18:33.929 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 31/36 2024-05-09T12:18:33.959 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:33.985 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 32/36 2024-05-09T12:18:33.986 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:33.986 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:18:33.986 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:33.986 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T12:18:33.986 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:34.465 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:34.465 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/36 2024-05-09T12:18:34.465 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/36 2024-05-09T12:18:34.465 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 3/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 4/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 5/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 6/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-09T12:18:34.466 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-09T12:18:34.467 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-09T12:18:34.468 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-09T12:18:34.469 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-09T12:18:34.963 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:34.963 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/36 2024-05-09T12:18:34.963 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/36 2024-05-09T12:18:34.963 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 3/36 2024-05-09T12:18:34.963 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 4/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 5/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 6/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-09T12:18:34.964 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-09T12:18:34.965 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-09T12:18:34.966 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-09T12:18:34.966 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-09T12:18:34.966 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-09T12:18:35.418 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 33/36 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T12:18:35.446 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-09T12:18:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:35.453 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:18:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:18:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:35.456 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:35.775 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-09T12:18:35.775 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:35.775 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:35.775 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.775 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:18:35.777 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:18:35.778 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:18:35.779 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:35.780 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:35.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-base 2024-05-09T12:18:35.885 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:35.909 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 34/36 2024-05-09T12:18:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:18:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T12:18:35.910 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:36.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-base 2024-05-09T12:18:36.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:36.160 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 35/36 2024-05-09T12:18:36.160 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:36.160 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:18:36.161 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:36.161 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T12:18:36.161 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:36.224 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:36.408 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:58 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:36.489 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:36.530 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:36.531 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:18:36.531 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:36.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install cephadm 2024-05-09T12:18:36.679 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:02 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:36.760 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:36.802 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:36.803 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:18:36.803 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:36.865 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install cephadm 2024-05-09T12:18:37.165 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:59 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:37.287 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 763 k 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 763 k 2024-05-09T12:18:37.288 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 770 k 2024-05-09T12:18:37.289 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:37.422 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:03 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:37.545 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:37.545 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:37.545 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:18:37.545 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 763 k 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 763 k 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 770 k 2024-05-09T12:18:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:37.634 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm-19.0.0-3575.g720f8e95.el9.noarch.rpm 2.2 MB/s | 763 kB 00:00 2024-05-09T12:18:37.635 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:37.635 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.1 MB/s | 763 kB 00:00 2024-05-09T12:18:37.635 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:37.640 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:37.640 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:37.646 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:37.646 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:37.719 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:37.896 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 36/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 3/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 4/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 5/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9. 6/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-09T12:18:37.897 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-09T12:18:37.898 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-09T12:18:37.899 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-09T12:18:37.900 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-09T12:18:37.915 INFO:teuthology.orchestra.run.smithi188.stdout:cephadm-19.0.0-3575.g720f8e95.el9.noarch.rpm 2.0 MB/s | 763 kB 00:00 2024-05-09T12:18:37.916 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:37.917 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.0 MB/s | 763 kB 00:00 2024-05-09T12:18:37.917 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:37.922 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:37.922 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:37.928 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:37.928 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:37.997 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:38.156 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.392 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.474 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.631 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.884 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.903 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:38.903 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:38.904 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:38.904 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:38.904 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:38.904 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:18:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:18:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:18:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:18:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:18:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:18:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:38.915 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:39.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:39.140 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:39.293 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-base 2024-05-09T12:18:39.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T12:18:39.698 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:01 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:39.821 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 145 k 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:18:39.822 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:39.823 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 145 k 2024-05-09T12:18:39.823 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 435 k 2024-05-09T12:18:39.823 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:39.861 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:04 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:39.926 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:05 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:39.941 INFO:teuthology.orchestra.run.smithi160.stdout:Package ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:39.982 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:39.983 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:18:39.983 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:40.053 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-immutable-object-cache-19.0.0-3575.g720f8e 631 kB/s | 145 kB 00:00 2024-05-09T12:18:40.053 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:40.054 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:40.054 INFO:teuthology.orchestra.run.smithi135.stdout:Total 626 kB/s | 145 kB 00:00 2024-05-09T12:18:40.054 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 145 k 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 145 k 2024-05-09T12:18:40.055 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 435 k 2024-05-09T12:18:40.056 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:40.060 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install cephadm 2024-05-09T12:18:40.062 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:40.062 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:40.119 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:40.119 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:40.261 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:40.354 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:40.364 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-immutable-object-cache-19.0.0-3575.g720f8e 469 kB/s | 145 kB 00:00 2024-05-09T12:18:40.364 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:40.365 INFO:teuthology.orchestra.run.smithi188.stdout:Total 466 kB/s | 145 kB 00:00 2024-05-09T12:18:40.365 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:40.373 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:40.373 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:40.379 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:40.379 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:40.379 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:18:40.379 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:40.429 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:40.429 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:40.575 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:40.626 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:05 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:40.640 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:40.665 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:40.666 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:40.666 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:18:40.666 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:40.748 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:40.750 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:40.750 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:18:40.750 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:40.750 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 763 k 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:18:40.751 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:40.752 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 763 k 2024-05-09T12:18:40.752 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 770 k 2024-05-09T12:18:40.752 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:41.279 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:41.319 INFO:teuthology.orchestra.run.smithi160.stdout:cephadm-19.0.0-3575.g720f8e95.el9.noarch.rpm 1.3 MB/s | 763 kB 00:00 2024-05-09T12:18:41.319 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:41.320 INFO:teuthology.orchestra.run.smithi160.stdout:Total 1.3 MB/s | 763 kB 00:00 2024-05-09T12:18:41.320 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:41.325 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:41.325 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:41.331 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:41.332 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:41.407 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:41.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:41.605 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:41.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr 2024-05-09T12:18:41.890 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:41.990 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:42.080 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:04 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:42.166 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:42.209 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:42.210 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:18:42.210 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:42.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T12:18:42.366 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:42.414 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:08 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:42.495 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:42.538 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:42.540 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:18:42.540 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:42.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T12:18:42.616 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:18:42.617 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:42.617 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:42.617 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:42.617 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:42.617 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:42.821 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-immutable-object-cache 2024-05-09T12:18:42.845 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:04 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:42.970 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 3.5 M 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 34 k 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 16 k 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T12:18:42.971 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout:Install 12 Packages 2024-05-09T12:18:42.972 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:42.973 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 8.6 M 2024-05-09T12:18:42.973 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 104 M 2024-05-09T12:18:42.973 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:43.162 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:09 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:43.285 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:43.286 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:43.286 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 3.5 M 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 34 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 16 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T12:18:43.287 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout:Install 12 Packages 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:43.288 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 8.6 M 2024-05-09T12:18:43.289 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 104 M 2024-05-09T12:18:43.289 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:43.403 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:08 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:43.473 INFO:teuthology.orchestra.run.smithi135.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3575.g72 132 kB/s | 34 kB 00:00 2024-05-09T12:18:43.490 INFO:teuthology.orchestra.run.smithi135.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3575.g720 59 kB/s | 16 kB 00:00 2024-05-09T12:18:43.528 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 145 k 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:18:43.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:43.530 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 145 k 2024-05-09T12:18:43.530 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 435 k 2024-05-09T12:18:43.530 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:43.679 INFO:teuthology.orchestra.run.smithi188.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3575.g720 85 kB/s | 16 kB 00:00 2024-05-09T12:18:43.779 INFO:teuthology.orchestra.run.smithi188.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3575.g72 116 kB/s | 34 kB 00:00 2024-05-09T12:18:43.884 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-immutable-object-cache-19.0.0-3575.g720f8e 410 kB/s | 145 kB 00:00 2024-05-09T12:18:43.884 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:43.884 INFO:teuthology.orchestra.run.smithi160.stdout:Total 408 kB/s | 145 kB 00:00 2024-05-09T12:18:43.885 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:43.892 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:43.892 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:43.896 INFO:teuthology.orchestra.run.smithi188.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-05-09T12:18:43.949 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:43.949 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:43.980 INFO:teuthology.orchestra.run.smithi188.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-05-09T12:18:44.093 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:44.196 INFO:teuthology.orchestra.run.smithi188.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.8 MB/s | 863 kB 00:00 2024-05-09T12:18:44.197 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:44.222 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:18:44.222 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:18:44.222 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:44.314 INFO:teuthology.orchestra.run.smithi188.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3575.g720f8e9 4.3 MB/s | 3.5 MB 00:00 2024-05-09T12:18:44.340 INFO:teuthology.orchestra.run.smithi135.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 317 kB/s | 269 kB 00:00 2024-05-09T12:18:44.465 INFO:teuthology.orchestra.run.smithi135.stdout:(4/12): ceph-mgr-dashboard-19.0.0-3575.g720f8e9 2.8 MB/s | 3.5 MB 00:01 2024-05-09T12:18:44.499 INFO:teuthology.orchestra.run.smithi135.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-09T12:18:44.624 INFO:teuthology.orchestra.run.smithi135.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-05-09T12:18:44.647 INFO:teuthology.orchestra.run.smithi188.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 43 kB/s | 19 kB 00:00 2024-05-09T12:18:44.750 INFO:teuthology.orchestra.run.smithi135.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.9 MB/s | 548 kB 00:00 2024-05-09T12:18:44.817 INFO:teuthology.orchestra.run.smithi135.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-05-09T12:18:44.875 INFO:teuthology.orchestra.run.smithi135.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 525 kB/s | 31 kB 00:00 2024-05-09T12:18:44.934 INFO:teuthology.orchestra.run.smithi135.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.6 MB/s | 2.0 MB 00:00 2024-05-09T12:18:44.959 INFO:teuthology.orchestra.run.smithi135.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-05-09T12:18:45.072 INFO:teuthology.orchestra.run.smithi188.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 2.7 MB/s | 2.0 MB 00:00 2024-05-09T12:18:45.097 INFO:teuthology.orchestra.run.smithi188.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 321 kB/s | 144 kB 00:00 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95. 1/1 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:45.099 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:45.131 INFO:teuthology.orchestra.run.smithi188.stdout:(10/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 476 kB/s | 548 kB 00:01 2024-05-09T12:18:45.181 INFO:teuthology.orchestra.run.smithi188.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 283 kB/s | 31 kB 00:00 2024-05-09T12:18:45.201 INFO:teuthology.orchestra.run.smithi135.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-05-09T12:18:45.203 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:45.203 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.9 MB/s | 8.6 MB 00:02 2024-05-09T12:18:45.206 INFO:teuthology.orchestra.run.smithi188.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-05-09T12:18:45.209 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:45.209 INFO:teuthology.orchestra.run.smithi188.stdout:Total 4.5 MB/s | 8.6 MB 00:01 2024-05-09T12:18:45.254 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:45.262 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:45.272 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:45.272 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:45.281 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:45.281 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:45.329 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr 2024-05-09T12:18:45.456 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:45.456 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:45.461 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:45.461 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:45.906 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:10 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:45.987 INFO:teuthology.orchestra.run.smithi160.stdout:Package ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:18:46.029 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:46.029 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:18:46.030 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:46.056 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:46.077 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:46.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-dashboard 2024-05-09T12:18:46.133 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-09T12:18:46.161 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-09T12:18:46.177 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-09T12:18:46.196 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-09T12:18:46.223 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-09T12:18:46.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-09T12:18:46.261 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-09T12:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-09T12:18:46.377 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-09T12:18:46.377 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-09T12:18:46.507 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-09T12:18:46.513 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-09T12:18:46.601 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-09T12:18:46.606 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-09T12:18:46.653 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-09T12:18:46.661 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:11 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:46.666 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-09T12:18:46.680 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:46.694 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:46.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 10/12 2024-05-09T12:18:46.726 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 10/12 2024-05-09T12:18:46.784 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 3.5 M 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 34 k 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 16 k 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T12:18:46.785 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout:Install 12 Packages 2024-05-09T12:18:46.786 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:46.787 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 8.6 M 2024-05-09T12:18:46.787 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 104 M 2024-05-09T12:18:46.787 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:47.504 INFO:teuthology.orchestra.run.smithi160.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3575.g720 67 kB/s | 16 kB 00:00 2024-05-09T12:18:47.530 INFO:teuthology.orchestra.run.smithi160.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3575.g72 126 kB/s | 34 kB 00:00 2024-05-09T12:18:47.705 INFO:teuthology.orchestra.run.smithi160.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-05-09T12:18:47.759 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 11/12 2024-05-09T12:18:47.780 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 11/12 2024-05-09T12:18:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:47.818 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:47.830 INFO:teuthology.orchestra.run.smithi160.stdout:(4/12): ceph-mgr-dashboard-19.0.0-3575.g720f8e9 6.2 MB/s | 3.5 MB 00:00 2024-05-09T12:18:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-05-09T12:18:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.9 MB/s | 863 kB 00:00 2024-05-09T12:18:48.131 INFO:teuthology.orchestra.run.smithi160.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 111 kB/s | 19 kB 00:00 2024-05-09T12:18:48.156 INFO:teuthology.orchestra.run.smithi160.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.6 MB/s | 548 kB 00:00 2024-05-09T12:18:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 369 kB/s | 31 kB 00:00 2024-05-09T12:18:48.307 INFO:teuthology.orchestra.run.smithi160.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 824 kB/s | 144 kB 00:00 2024-05-09T12:18:48.407 INFO:teuthology.orchestra.run.smithi160.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.0 MB/s | 2.0 MB 00:00 2024-05-09T12:18:48.507 INFO:teuthology.orchestra.run.smithi160.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 706 kB/s | 188 kB 00:00 2024-05-09T12:18:48.510 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:48.510 INFO:teuthology.orchestra.run.smithi160.stdout:Total 5.0 MB/s | 8.6 MB 00:01 2024-05-09T12:18:48.564 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:48.582 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:48.582 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:48.784 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:48.784 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 1/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 2/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 3/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-09T12:18:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-09T12:18:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 1/12 2024-05-09T12:18:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 2/12 2024-05-09T12:18:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 3/12 2024-05-09T12:18:49.152 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-09T12:18:49.153 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-09T12:18:49.154 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-09T12:18:49.310 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.311 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:18:49.312 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:18:49.313 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:18:49.313 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:49.313 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:18:49.380 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:49.444 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:49.445 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:18:49.450 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-09T12:18:49.485 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-09T12:18:49.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T12:18:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-09T12:18:49.562 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-09T12:18:49.685 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-09T12:18:49.696 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T12:18:49.821 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-09T12:18:49.962 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-09T12:18:50.011 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-09T12:18:50.039 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:50.071 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 10/12 2024-05-09T12:18:50.098 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:16 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:18:50.219 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:18:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-05-09T12:18:50.220 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:18:50.220 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 7.4 M 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T12:18:50.221 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================= 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout:Install 12 Packages 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:18:50.222 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 38 M 2024-05-09T12:18:50.223 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 209 M 2024-05-09T12:18:50.223 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:18:50.276 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:12 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:18:50.408 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:18:50.409 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-09T12:18:50.409 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 7.4 M 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T12:18:50.410 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T12:18:50.411 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T12:18:50.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:50.412 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:18:50.412 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-05-09T12:18:50.412 INFO:teuthology.orchestra.run.smithi135.stdout:Install 12 Packages 2024-05-09T12:18:50.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:18:50.413 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 38 M 2024-05-09T12:18:50.413 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 209 M 2024-05-09T12:18:50.413 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:18:50.573 INFO:teuthology.orchestra.run.smithi188.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-05-09T12:18:50.665 INFO:teuthology.orchestra.run.smithi188.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-05-09T12:18:50.690 INFO:teuthology.orchestra.run.smithi188.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-05-09T12:18:50.741 INFO:teuthology.orchestra.run.smithi188.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-05-09T12:18:50.833 INFO:teuthology.orchestra.run.smithi188.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 384 kB/s | 35 kB 00:00 2024-05-09T12:18:51.059 INFO:teuthology.orchestra.run.smithi135.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 364 kB/s | 195 kB 00:00 2024-05-09T12:18:51.123 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 11/12 2024-05-09T12:18:51.141 INFO:teuthology.orchestra.run.smithi188.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-35 10 MB/s | 7.4 MB 00:00 2024-05-09T12:18:51.162 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:51.184 INFO:teuthology.orchestra.run.smithi135.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 262 kB/s | 33 kB 00:00 2024-05-09T12:18:51.309 INFO:teuthology.orchestra.run.smithi135.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-05-09T12:18:51.316 INFO:teuthology.orchestra.run.smithi188.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-05-09T12:18:51.408 INFO:teuthology.orchestra.run.smithi188.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.0 MB/s | 3.0 MB 00:00 2024-05-09T12:18:51.435 INFO:teuthology.orchestra.run.smithi135.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 145 kB/s | 18 kB 00:00 2024-05-09T12:18:51.525 INFO:teuthology.orchestra.run.smithi188.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-05-09T12:18:51.577 INFO:teuthology.orchestra.run.smithi135.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 249 kB/s | 35 kB 00:00 2024-05-09T12:18:51.703 INFO:teuthology.orchestra.run.smithi135.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-35 6.3 MB/s | 7.4 MB 00:01 2024-05-09T12:18:51.753 INFO:teuthology.orchestra.run.smithi135.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.3 MB/s | 3.0 MB 00:00 2024-05-09T12:18:51.961 INFO:teuthology.orchestra.run.smithi135.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 945 kB/s | 244 kB 00:00 2024-05-09T12:18:52.095 INFO:teuthology.orchestra.run.smithi135.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.8 MB/s | 250 kB 00:00 2024-05-09T12:18:52.100 INFO:teuthology.orchestra.run.smithi188.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.7 MB/s | 4.7 MB 00:01 2024-05-09T12:18:52.245 INFO:teuthology.orchestra.run.smithi135.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-05-09T12:18:52.434 INFO:teuthology.orchestra.run.smithi188.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-05-09T12:18:52.503 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 12/12 2024-05-09T12:18:52.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el 1/12 2024-05-09T12:18:52.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noa 2/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9 3/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-09T12:18:52.504 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:18:52.847 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:52.848 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:18:52.895 INFO:teuthology.orchestra.run.smithi135.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.6 MB/s | 4.7 MB 00:01 2024-05-09T12:18:53.079 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-09T12:18:53.662 INFO:teuthology.orchestra.run.smithi135.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-09T12:18:53.663 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:53.663 INFO:teuthology.orchestra.run.smithi135.stdout:Total 12 MB/s | 38 MB 00:03 2024-05-09T12:18:53.667 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:18 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:18:53.798 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 7.4 M 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T12:18:53.799 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout:Install 12 Packages 2024-05-09T12:18:53.800 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:18:53.801 INFO:teuthology.orchestra.run.smithi188.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.1 MB/s | 16 MB 00:02 2024-05-09T12:18:53.801 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 38 M 2024-05-09T12:18:53.801 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 209 M 2024-05-09T12:18:53.802 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:18:53.802 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:53.802 INFO:teuthology.orchestra.run.smithi188.stdout:Total 11 MB/s | 38 MB 00:03 2024-05-09T12:18:54.016 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:18:54.043 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:18:54.043 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:18:54.156 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:18:54.181 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:18:54.182 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:18:54.367 INFO:teuthology.orchestra.run.smithi160.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-05-09T12:18:54.417 INFO:teuthology.orchestra.run.smithi160.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2024-05-09T12:18:54.451 INFO:teuthology.orchestra.run.smithi160.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-05-09T12:18:54.466 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:18:54.467 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:18:54.501 INFO:teuthology.orchestra.run.smithi160.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-05-09T12:18:54.552 INFO:teuthology.orchestra.run.smithi160.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-05-09T12:18:54.605 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:18:54.605 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:18:54.627 INFO:teuthology.orchestra.run.smithi160.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-05-09T12:18:54.752 INFO:teuthology.orchestra.run.smithi160.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-05-09T12:18:54.877 INFO:teuthology.orchestra.run.smithi160.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-05-09T12:18:54.969 INFO:teuthology.orchestra.run.smithi160.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-35 9.9 MB/s | 7.4 MB 00:00 2024-05-09T12:18:55.061 INFO:teuthology.orchestra.run.smithi160.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.3 MB/s | 250 kB 00:00 2024-05-09T12:18:55.136 INFO:teuthology.orchestra.run.smithi160.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-09T12:18:55.229 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:18:55.295 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T12:18:55.343 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:18:55.351 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:18:55.422 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T12:18:55.443 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:18:55.457 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:18:55.477 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T12:18:55.520 INFO:teuthology.orchestra.run.smithi160.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-05-09T12:18:55.521 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:18:55.521 INFO:teuthology.orchestra.run.smithi160.stdout:Total 22 MB/s | 38 MB 00:01 2024-05-09T12:18:55.555 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:18:55.591 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T12:18:55.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T12:18:55.685 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T12:18:55.770 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T12:18:55.772 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T12:18:55.807 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T12:18:55.874 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:18:55.895 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T12:18:55.900 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:18:55.901 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:18:56.354 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:18:56.355 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:18:56.417 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T12:18:56.540 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T12:18:56.552 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T12:18:56.660 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T12:18:57.126 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:18:57.208 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-09T12:18:57.251 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:18:57.352 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:18:57.386 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-09T12:18:57.565 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-09T12:18:57.593 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-09T12:18:57.671 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-09T12:18:57.788 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:18:57.903 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:18:58.345 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-09T12:18:58.464 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-09T12:18:58.828 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T12:18:58.858 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:18:58.952 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T12:18:58.972 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:18:59.720 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:19:00.771 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-09T12:19:00.808 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 1/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T12:19:01.677 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T12:19:01.678 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T12:19:01.678 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:19:01.678 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 1/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T12:19:01.706 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:19:01.707 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.054 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:02.055 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:02.115 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T12:19:02.115 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:02.115 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:02.116 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:02.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-rook 2024-05-09T12:19:02.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-rook 2024-05-09T12:19:02.957 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:24 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:03.026 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:29 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:03.079 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:03.080 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 49 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T12:19:03.081 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-05-09T12:19:03.082 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:03.083 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.2 M 2024-05-09T12:19:03.083 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 26 M 2024-05-09T12:19:03.083 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:03.148 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 49 k 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T12:19:03.149 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout:Install 13 Packages 2024-05-09T12:19:03.150 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:03.151 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 2.2 M 2024-05-09T12:19:03.151 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 26 M 2024-05-09T12:19:03.151 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:03.267 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 12/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8 1/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-09T12:19:03.268 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-09T12:19:03.506 INFO:teuthology.orchestra.run.smithi188.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 345 kB/s | 26 kB 00:00 2024-05-09T12:19:03.531 INFO:teuthology.orchestra.run.smithi188.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 193 kB/s | 19 kB 00:00 2024-05-09T12:19:03.617 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 97 kB/s | 26 kB 00:00 2024-05-09T12:19:03.631 INFO:teuthology.orchestra.run.smithi188.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-05-09T12:19:03.631 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:19:03.632 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:03.633 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:19:03.633 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:19:03.633 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:03.633 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:03.642 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 66 kB/s | 19 kB 00:00 2024-05-09T12:19:03.656 INFO:teuthology.orchestra.run.smithi188.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.1 MB/s | 222 kB 00:00 2024-05-09T12:19:03.715 INFO:teuthology.orchestra.run.smithi188.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 936 kB/s | 54 kB 00:00 2024-05-09T12:19:03.740 INFO:teuthology.orchestra.run.smithi188.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-05-09T12:19:03.751 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): ceph-mgr-rook-19.0.0-3575.g720f8e95.el9 124 kB/s | 49 kB 00:00 2024-05-09T12:19:03.882 INFO:teuthology.orchestra.run.smithi188.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 106 kB/s | 15 kB 00:00 2024-05-09T12:19:03.907 INFO:teuthology.orchestra.run.smithi188.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 167 kB/s | 32 kB 00:00 2024-05-09T12:19:03.991 INFO:teuthology.orchestra.run.smithi188.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 1.8 MB/s | 206 kB 00:00 2024-05-09T12:19:03.993 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 453 kB/s | 159 kB 00:00 2024-05-09T12:19:04.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-rook 2024-05-09T12:19:04.016 INFO:teuthology.orchestra.run.smithi188.stdout:(10/13): ceph-mgr-rook-19.0.0-3575.g720f8e95.el 84 kB/s | 49 kB 00:00 2024-05-09T12:19:04.060 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 502 kB/s | 222 kB 00:00 2024-05-09T12:19:04.083 INFO:teuthology.orchestra.run.smithi188.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-05-09T12:19:04.093 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 536 kB/s | 54 kB 00:00 2024-05-09T12:19:04.108 INFO:teuthology.orchestra.run.smithi188.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 507 kB/s | 59 kB 00:00 2024-05-09T12:19:04.133 INFO:teuthology.orchestra.run.smithi188.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 766 kB/s | 90 kB 00:00 2024-05-09T12:19:04.136 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:04.136 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.2 MB/s | 2.2 MB 00:00 2024-05-09T12:19:04.200 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:04.215 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:04.215 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:04.285 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 143 kB/s | 32 kB 00:00 2024-05-09T12:19:04.298 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:04.298 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:04.319 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 66 kB/s | 15 kB 00:00 2024-05-09T12:19:04.436 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 1.3 MB/s | 206 kB 00:00 2024-05-09T12:19:04.461 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 393 kB/s | 279 kB 00:00 2024-05-09T12:19:04.512 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-05-09T12:19:04.553 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 4.4 MB/s | 1.0 MB 00:00 2024-05-09T12:19:04.578 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 770 kB/s | 90 kB 00:00 2024-05-09T12:19:04.580 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:04.580 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-05-09T12:19:04.594 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:29 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:04.644 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:04.660 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:04.661 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:04.717 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 49 k 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T12:19:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout:Install 13 Packages 2024-05-09T12:19:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:04.721 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 2.2 M 2024-05-09T12:19:04.721 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 26 M 2024-05-09T12:19:04.721 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:04.745 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:04.745 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:04.848 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:05.003 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T12:19:05.059 INFO:teuthology.orchestra.run.smithi160.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 140 kB/s | 19 kB 00:00 2024-05-09T12:19:05.067 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T12:19:05.083 INFO:teuthology.orchestra.run.smithi160.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 159 kB/s | 26 kB 00:00 2024-05-09T12:19:05.123 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T12:19:05.160 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T12:19:05.184 INFO:teuthology.orchestra.run.smithi160.stdout:(3/13): ceph-mgr-rook-19.0.0-3575.g720f8e95.el9 189 kB/s | 49 kB 00:00 2024-05-09T12:19:05.201 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T12:19:05.241 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:05.242 INFO:teuthology.orchestra.run.smithi160.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-05-09T12:19:05.276 INFO:teuthology.orchestra.run.smithi160.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 826 kB/s | 159 kB 00:00 2024-05-09T12:19:05.294 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T12:19:05.309 INFO:teuthology.orchestra.run.smithi160.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 801 kB/s | 54 kB 00:00 2024-05-09T12:19:05.400 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T12:19:05.404 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T12:19:05.453 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T12:19:05.454 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T12:19:05.468 INFO:teuthology.orchestra.run.smithi160.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 982 kB/s | 279 kB 00:00 2024-05-09T12:19:05.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T12:19:05.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T12:19:05.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T12:19:05.690 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T12:19:05.752 INFO:teuthology.orchestra.run.smithi160.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 68 kB/s | 32 kB 00:00 2024-05-09T12:19:05.777 INFO:teuthology.orchestra.run.smithi160.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 32 kB/s | 15 kB 00:00 2024-05-09T12:19:05.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T12:19:05.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T12:19:06.044 INFO:teuthology.orchestra.run.smithi160.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 222 kB/s | 59 kB 00:00 2024-05-09T12:19:06.164 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T12:19:06.217 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T12:19:06.227 INFO:teuthology.orchestra.run.smithi160.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 489 kB/s | 90 kB 00:00 2024-05-09T12:19:06.251 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T12:19:06.299 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T12:19:06.320 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:06.352 INFO:teuthology.orchestra.run.smithi160.stdout:(12/13): python3-google-auth-2.29.0-1.el9.noarc 233 kB/s | 206 kB 00:00 2024-05-09T12:19:06.576 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T12:19:06.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T12:19:06.654 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T12:19:06.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T12:19:06.724 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:07.054 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:07.054 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T12:19:07.055 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T12:19:07.169 INFO:teuthology.orchestra.run.smithi160.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 737 kB/s | 1.0 MB 00:01 2024-05-09T12:19:07.172 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:07.172 INFO:teuthology.orchestra.run.smithi160.stdout:Total 919 kB/s | 2.2 MB 00:02 2024-05-09T12:19:07.242 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:07.258 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:07.258 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:07.345 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:07.347 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:07.372 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T12:19:07.372 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:07.372 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:07.372 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:07.372 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:07.373 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T12:19:07.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T12:19:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T12:19:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T12:19:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T12:19:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T12:19:07.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T12:19:07.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:19:07.850 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:07.851 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:07.855 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:08.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-09T12:19:08.087 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-09T12:19:08.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T12:19:08.151 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-09T12:19:08.170 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:34 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:08.188 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-09T12:19:08.229 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-09T12:19:08.292 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:08.292 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:08.292 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 142 k 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T12:19:08.293 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T12:19:08.294 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:08.294 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:08.294 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:08.294 INFO:teuthology.orchestra.run.smithi188.stdout:Install 6 Packages 2024-05-09T12:19:08.294 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:08.295 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 7.0 M 2024-05-09T12:19:08.295 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 33 M 2024-05-09T12:19:08.295 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:08.325 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-09T12:19:08.434 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-09T12:19:08.481 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-09T12:19:08.683 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:30 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:08.806 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:08.807 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:08.807 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:19:08.807 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:08.807 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:08.807 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 142 k 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-05-09T12:19:08.808 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:08.809 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 7.0 M 2024-05-09T12:19:08.809 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 33 M 2024-05-09T12:19:08.809 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:09.201 INFO:teuthology.orchestra.run.smithi188.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3575.g720f8e95.e 301 kB/s | 142 kB 00:00 2024-05-09T12:19:09.210 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-09T12:19:09.253 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-09T12:19:09.287 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-09T12:19:09.352 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-09T12:19:09.380 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-05-09T12:19:09.381 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:09.601 INFO:teuthology.orchestra.run.smithi188.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 284 kB/s | 248 kB 00:00 2024-05-09T12:19:09.605 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3575.g720f8e95.e 310 kB/s | 142 kB 00:00 2024-05-09T12:19:09.855 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-05-09T12:19:09.905 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 192 kB/s | 58 kB 00:00 2024-05-09T12:19:09.939 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 610 kB/s | 51 kB 00:00 2024-05-09T12:19:10.001 INFO:teuthology.orchestra.run.smithi188.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 685 kB/s | 548 kB 00:00 2024-05-09T12:19:10.144 INFO:teuthology.orchestra.run.smithi188.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-05-09T12:19:10.169 INFO:teuthology.orchestra.run.smithi188.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 305 kB/s | 51 kB 00:00 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 13/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-09T12:19:10.188 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-09T12:19:10.189 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-09T12:19:10.189 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-09T12:19:10.189 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-09T12:19:10.189 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-09T12:19:10.189 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-09T12:19:10.244 INFO:teuthology.orchestra.run.smithi188.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 90 kB/s | 58 kB 00:00 2024-05-09T12:19:10.246 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:10.246 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.6 MB/s | 7.0 MB 00:01 2024-05-09T12:19:10.317 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:10.329 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:10.329 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:10.427 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:10.427 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:10.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:19:10.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:10.505 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:10.648 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-05-09T12:19:10.650 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:10.650 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.8 MB/s | 7.0 MB 00:01 2024-05-09T12:19:10.722 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:10.728 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:10.733 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:10.733 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:10.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-cephadm 2024-05-09T12:19:10.831 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:10.833 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:10.892 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T12:19:10.937 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T12:19:11.135 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:11.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T12:19:11.318 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:36 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:11.357 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T12:19:11.441 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:11.441 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 142 k 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:11.442 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:11.443 INFO:teuthology.orchestra.run.smithi160.stdout:Install 6 Packages 2024-05-09T12:19:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:11.443 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 7.0 M 2024-05-09T12:19:11.443 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 33 M 2024-05-09T12:19:11.443 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:11.460 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T12:19:11.548 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T12:19:11.620 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T12:19:11.649 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:11.874 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T12:19:11.887 INFO:teuthology.orchestra.run.smithi160.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-05-09T12:19:11.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T12:19:12.023 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T12:19:12.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:12.138 INFO:teuthology.orchestra.run.smithi160.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3575.g720f8e95.e 304 kB/s | 142 kB 00:00 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/6 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T12:19:12.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T12:19:12.521 INFO:teuthology.orchestra.run.smithi160.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 151 kB/s | 58 kB 00:00 2024-05-09T12:19:12.588 INFO:teuthology.orchestra.run.smithi160.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 783 kB/s | 548 kB 00:00 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:19:12.689 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:19:12.690 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:12.690 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:12.755 INFO:teuthology.orchestra.run.smithi160.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 218 kB/s | 51 kB 00:00 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/6 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T12:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T12:19:12.925 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-fuse 2024-05-09T12:19:13.148 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:13.149 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:13.412 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-fuse 2024-05-09T12:19:13.475 INFO:teuthology.orchestra.run.smithi160.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-05-09T12:19:13.475 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:13.475 INFO:teuthology.orchestra.run.smithi160.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-05-09T12:19:13.492 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:39 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:13.547 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:13.558 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:13.558 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:13.614 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:13.614 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:13.614 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:19:13.614 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 892 k 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2024-05-09T12:19:13.615 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:13.616 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 972 k 2024-05-09T12:19:13.616 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 2.8 M 2024-05-09T12:19:13.616 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:13.656 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:13.657 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:13.829 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 551 kB/s | 80 kB 00:00 2024-05-09T12:19:13.957 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:13.979 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:35 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:14.101 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 892 k 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:14.102 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:14.103 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:14.103 INFO:teuthology.orchestra.run.smithi135.stdout:Install 2 Packages 2024-05-09T12:19:14.103 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:14.103 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 972 k 2024-05-09T12:19:14.103 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 2.8 M 2024-05-09T12:19:14.104 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:14.137 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-09T12:19:14.191 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-09T12:19:14.438 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): ceph-fuse-19.0.0-3575.g720f8e95.el9.x86_ 1.2 MB/s | 892 kB 00:00 2024-05-09T12:19:14.439 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:14.439 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.2 MB/s | 972 kB 00:00 2024-05-09T12:19:14.451 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:14.474 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:14.474 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:14.553 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:14.554 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:14.641 INFO:teuthology.orchestra.run.smithi135.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-05-09T12:19:14.714 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-09T12:19:14.755 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:14.802 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-09T12:19:14.865 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-09T12:19:14.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:14.898 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T12:19:14.969 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:15.150 INFO:teuthology.orchestra.run.smithi135.stdout:(2/2): ceph-fuse-19.0.0-3575.g720f8e95.el9.x86_ 957 kB/s | 892 kB 00:00 2024-05-09T12:19:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:15.151 INFO:teuthology.orchestra.run.smithi135.stdout:Total 927 kB/s | 972 kB 00:01 2024-05-09T12:19:15.163 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:15.185 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:15.185 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:15.264 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:15.264 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:15.462 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:15.602 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T12:19:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:15.632 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:19:15.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 6/6 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/6 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-09T12:19:15.673 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:15.921 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:15.936 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:15.937 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:16.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-volume 2024-05-09T12:19:16.208 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-fuse 2024-05-09T12:19:16.347 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:16.347 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:19:16.653 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:19:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:16.654 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:19:16.654 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:16.654 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:16.779 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:41 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:16.782 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:42 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:16.901 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 892 k 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T12:19:16.902 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:16.903 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:16.903 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:16.903 INFO:teuthology.orchestra.run.smithi160.stdout:Install 2 Packages 2024-05-09T12:19:16.903 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:16.903 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 972 k 2024-05-09T12:19:16.904 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 2.8 M 2024-05-09T12:19:16.904 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:16.908 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 273 k 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:16.909 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:16.910 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:16.910 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2024-05-09T12:19:16.910 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:16.910 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 350 k 2024-05-09T12:19:16.910 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 1.5 M 2024-05-09T12:19:16.911 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:16.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-volume 2024-05-09T12:19:17.124 INFO:teuthology.orchestra.run.smithi160.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 823 kB/s | 80 kB 00:00 2024-05-09T12:19:17.442 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): ceph-volume-19.0.0-3575.g720f8e95.el9.no 673 kB/s | 273 kB 00:00 2024-05-09T12:19:17.465 INFO:teuthology.orchestra.run.smithi160.stdout:(2/2): ceph-fuse-19.0.0-3575.g720f8e95.el9.x86_ 2.0 MB/s | 892 kB 00:00 2024-05-09T12:19:17.466 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:17.466 INFO:teuthology.orchestra.run.smithi160.stdout:Total 1.7 MB/s | 972 kB 00:00 2024-05-09T12:19:17.478 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:17.501 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:17.501 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:17.529 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:39 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:17.579 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:17.579 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:17.651 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 273 k 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:17.652 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:17.653 INFO:teuthology.orchestra.run.smithi135.stdout:Install 2 Packages 2024-05-09T12:19:17.653 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:17.653 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 350 k 2024-05-09T12:19:17.653 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 1.5 M 2024-05-09T12:19:17.653 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:17.734 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 111 kB/s | 77 kB 00:00 2024-05-09T12:19:17.735 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:17.735 INFO:teuthology.orchestra.run.smithi188.stdout:Total 424 kB/s | 350 kB 00:00 2024-05-09T12:19:17.747 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:17.757 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:17.757 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:17.772 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:17.789 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:17.790 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:17.909 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-09T12:19:17.932 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:17.981 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:18.013 INFO:teuthology.orchestra.run.smithi135.stdout:(1/2): ceph-volume-19.0.0-3575.g720f8e95.el9.no 1.2 MB/s | 273 kB 00:00 2024-05-09T12:19:18.115 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-09T12:19:18.145 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:18.160 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:18.160 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:18.160 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:19:18.160 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:18.238 INFO:teuthology.orchestra.run.smithi135.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 174 kB/s | 77 kB 00:00 2024-05-09T12:19:18.239 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:18.239 INFO:teuthology.orchestra.run.smithi135.stdout:Total 597 kB/s | 350 kB 00:00 2024-05-09T12:19:18.251 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:18.261 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:18.261 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:18.298 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:18.299 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:18.459 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:18.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-09T12:19:18.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:18.681 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:18.682 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:18.682 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:19:18.682 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:18.691 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/2 2024-05-09T12:19:18.691 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:19:18.899 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 1/2 2024-05-09T12:19:18.986 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:19:18.986 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:18.986 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:18.987 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:19:18.987 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:18.987 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:19.213 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-09T12:19:19.213 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:19.214 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:19.214 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:19.214 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:19:19.214 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:19.214 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:19.236 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-volume 2024-05-09T12:19:19.443 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 1/2 2024-05-09T12:19:19.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados-devel 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:19.747 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:19.823 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:44 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:19.951 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:19.951 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 ceph-noarch 273 k 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:19.952 INFO:teuthology.orchestra.run.smithi160.stdout:Install 2 Packages 2024-05-09T12:19:19.953 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:19.953 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 350 k 2024-05-09T12:19:19.953 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 1.5 M 2024-05-09T12:19:19.953 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:20.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados-devel 2024-05-09T12:19:20.089 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:46 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:20.221 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:20.221 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 127 k 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 127 k 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 456 k 2024-05-09T12:19:20.222 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:20.294 INFO:teuthology.orchestra.run.smithi160.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 354 kB/s | 77 kB 00:00 2024-05-09T12:19:20.320 INFO:teuthology.orchestra.run.smithi160.stdout:(2/2): ceph-volume-19.0.0-3575.g720f8e95.el9.no 1.1 MB/s | 273 kB 00:00 2024-05-09T12:19:20.320 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:20.320 INFO:teuthology.orchestra.run.smithi160.stdout:Total 951 kB/s | 350 kB 00:00 2024-05-09T12:19:20.333 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:20.343 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:20.343 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:20.374 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:20.374 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:20.448 INFO:teuthology.orchestra.run.smithi188.stdout:librados-devel-19.0.0-3575.g720f8e95.el9.x86_64 565 kB/s | 127 kB 00:00 2024-05-09T12:19:20.448 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:20.449 INFO:teuthology.orchestra.run.smithi188.stdout:Total 559 kB/s | 127 kB 00:00 2024-05-09T12:19:20.449 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:20.455 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:20.455 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:20.519 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:20.526 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:20.526 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:20.688 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:20.688 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:42 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:20.717 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-09T12:19:20.755 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:20.771 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2/2 2024-05-09T12:19:20.771 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:20.771 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:19:20.771 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:20.792 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:20.813 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:20.814 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:20.814 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:19:20.814 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 127 k 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 127 k 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 456 k 2024-05-09T12:19:20.815 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:21.136 INFO:teuthology.orchestra.run.smithi135.stdout:librados-devel-19.0.0-3575.g720f8e95.el9.x86_64 396 kB/s | 127 kB 00:00 2024-05-09T12:19:21.137 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:21.137 INFO:teuthology.orchestra.run.smithi135.stdout:Total 394 kB/s | 127 kB 00:00 2024-05-09T12:19:21.137 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:21.142 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:21.142 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:21.210 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:21.210 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:21.258 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:21.368 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:21.457 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 1/2 2024-05-09T12:19:21.472 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:21.489 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:21.490 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:21.490 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:21.490 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:21.490 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:21.490 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:21.744 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:21.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs2 2024-05-09T12:19:21.944 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:22.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librados-devel 2024-05-09T12:19:22.198 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:22.198 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:22.198 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:22.198 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:22.198 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:22.199 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:22.330 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:48 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:22.410 INFO:teuthology.orchestra.run.smithi188.stdout:Package libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:22.452 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:22.453 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:22.453 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:22.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs2 2024-05-09T12:19:22.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs-devel 2024-05-09T12:19:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:47 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:22.748 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:22.749 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:22.749 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:19:22.749 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:22.749 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:22.749 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 127 k 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 127 k 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 456 k 2024-05-09T12:19:22.750 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:22.982 INFO:teuthology.orchestra.run.smithi160.stdout:librados-devel-19.0.0-3575.g720f8e95.el9.x86_64 548 kB/s | 127 kB 00:00 2024-05-09T12:19:22.983 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:22.983 INFO:teuthology.orchestra.run.smithi160.stdout:Total 544 kB/s | 127 kB 00:00 2024-05-09T12:19:22.983 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:22.988 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:22.988 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:23.052 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:45 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:23.058 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:23.058 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:23.087 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:23.135 INFO:teuthology.orchestra.run.smithi135.stdout:Package libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:23.179 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:23.180 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:23.180 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:23.210 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:23.210 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:23.210 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:19:23.210 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 32 k 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:19:23.211 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:23.212 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 32 k 2024-05-09T12:19:23.212 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 142 k 2024-05-09T12:19:23.212 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:23.230 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:23.245 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs-devel 2024-05-09T12:19:23.338 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:23.389 INFO:teuthology.orchestra.run.smithi188.stdout:libcephfs-devel-19.0.0-3575.g720f8e95.el9.x86_6 179 kB/s | 32 kB 00:00 2024-05-09T12:19:23.390 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:23.390 INFO:teuthology.orchestra.run.smithi188.stdout:Total 177 kB/s | 32 kB 00:00 2024-05-09T12:19:23.390 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:23.394 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:23.394 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:23.409 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:23.409 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:23.494 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:23.595 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:23.813 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:45 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:23.840 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 32 k 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:23.938 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 32 k 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 142 k 2024-05-09T12:19:23.939 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:23.959 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:24.079 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:24.102 INFO:teuthology.orchestra.run.smithi135.stdout:libcephfs-devel-19.0.0-3575.g720f8e95.el9.x86_6 193 kB/s | 32 kB 00:00 2024-05-09T12:19:24.103 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:24.103 INFO:teuthology.orchestra.run.smithi135.stdout:Total 191 kB/s | 32 kB 00:00 2024-05-09T12:19:24.103 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:24.106 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:24.106 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:24.122 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:24.122 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:24.178 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.178 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:24.178 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:24.178 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:24.178 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:24.179 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:24.202 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:24.307 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados2 2024-05-09T12:19:24.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install libcephfs2 2024-05-09T12:19:24.698 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.915 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:24.930 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:24.931 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:24.931 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:24.931 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:24.968 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:24.996 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:25.038 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:25.039 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:25.039 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:25.053 INFO:teuthology.orchestra.run.smithi160.stdout:Package libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:25.095 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librbd1 2024-05-09T12:19:25.097 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:25.098 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:25.098 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:25.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados2 2024-05-09T12:19:25.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install libcephfs-devel 2024-05-09T12:19:25.666 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:51 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:25.667 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:47 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:25.731 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:25.747 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:25.748 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:25.789 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:25.789 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:25.790 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:25.790 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:25.790 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:25.790 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:25.852 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:25.853 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:25.853 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:19:25.853 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:25.853 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:25.853 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 32 k 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 32 k 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 142 k 2024-05-09T12:19:25.854 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:25.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rados 2024-05-09T12:19:25.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librbd1 2024-05-09T12:19:26.045 INFO:teuthology.orchestra.run.smithi160.stdout:libcephfs-devel-19.0.0-3575.g720f8e95.el9.x86_6 166 kB/s | 32 kB 00:00 2024-05-09T12:19:26.045 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:26.046 INFO:teuthology.orchestra.run.smithi160.stdout:Total 165 kB/s | 32 kB 00:00 2024-05-09T12:19:26.046 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:26.050 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:26.050 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:26.063 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:26.063 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:26.140 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:26.234 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:26.429 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:26.436 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:48 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:26.510 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:26.517 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:26.550 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:26.551 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:26.552 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:26.559 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:26.560 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:26.560 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:26.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rgw 2024-05-09T12:19:26.614 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:26.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rados 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:26.843 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:26.997 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librados2 2024-05-09T12:19:27.182 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:53 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:27.192 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:27.262 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:27.303 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:27.305 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:27.305 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:27.315 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:27.316 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:27.365 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-cephfs 2024-05-09T12:19:27.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rgw 2024-05-09T12:19:27.567 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:27.649 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:27.690 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:27.691 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:27.691 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:27.766 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librbd1 2024-05-09T12:19:27.925 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:53 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:27.953 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:49 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:28.005 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:28.034 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:28.047 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:28.048 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:28.049 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:28.076 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:28.077 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:28.077 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:28.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rbd 2024-05-09T12:19:28.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-cephfs 2024-05-09T12:19:28.331 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:53 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:28.411 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:28.454 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:28.454 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:28.455 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:28.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rados 2024-05-09T12:19:28.684 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:28.714 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:50 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:28.765 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:28.795 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:28.807 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:28.808 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:19:28.808 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:28.837 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:28.838 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:28.838 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:28.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-fuse 2024-05-09T12:19:28.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rbd 2024-05-09T12:19:29.085 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:29.165 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:29.207 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:29.208 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:29.208 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:29.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rgw 2024-05-09T12:19:29.444 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:29.494 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:51 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:29.568 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 85 k 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:29.569 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 85 k 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 231 k 2024-05-09T12:19:29.570 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:29.575 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:29.617 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:29.618 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:19:29.618 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:29.686 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-fuse 2024-05-09T12:19:29.847 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:29.929 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:29.971 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:29.972 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:29.972 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:30.032 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-cephfs 2024-05-09T12:19:30.034 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-fuse-19.0.0-3575.g720f8e95.el9.x86_64.rpm 184 kB/s | 85 kB 00:00 2024-05-09T12:19:30.035 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:30.035 INFO:teuthology.orchestra.run.smithi188.stdout:Total 184 kB/s | 85 kB 00:00 2024-05-09T12:19:30.035 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:30.042 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:30.042 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:30.104 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:30.104 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:30.247 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:30.258 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:52 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:30.373 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 85 k 2024-05-09T12:19:30.380 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 85 k 2024-05-09T12:19:30.381 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 231 k 2024-05-09T12:19:30.382 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:30.602 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:55 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:30.655 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-fuse-19.0.0-3575.g720f8e95.el9.x86_64.rpm 312 kB/s | 85 kB 00:00 2024-05-09T12:19:30.656 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:30.656 INFO:teuthology.orchestra.run.smithi135.stdout:Total 311 kB/s | 85 kB 00:00 2024-05-09T12:19:30.656 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:30.663 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:30.663 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:30.683 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:30.725 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:30.726 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:30.726 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:30.726 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:30.726 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:30.763 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:30.803 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rbd 2024-05-09T12:19:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:30.961 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:31.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:31.017 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:31.018 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:31.018 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:31.018 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:31.018 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:31.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-mirror 2024-05-09T12:19:31.375 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:56 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:31.405 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:31.457 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 is already installed. 2024-05-09T12:19:31.498 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:31.499 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:19:31.500 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:31.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-fuse 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:31.652 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:31.869 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:57 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:31.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-mirror 2024-05-09T12:19:31.996 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:31.996 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:31.997 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 3.1 M 2024-05-09T12:19:31.998 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 13 M 2024-05-09T12:19:31.998 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:32.141 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:57 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:32.265 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 85 k 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:32.266 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:19:32.267 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:32.267 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 85 k 2024-05-09T12:19:32.267 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 231 k 2024-05-09T12:19:32.267 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:32.475 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:54 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:32.600 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:32.601 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 3.1 M 2024-05-09T12:19:32.602 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 13 M 2024-05-09T12:19:32.602 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:32.681 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-fuse-19.0.0-3575.g720f8e95.el9.x86_64.rpm 206 kB/s | 85 kB 00:00 2024-05-09T12:19:32.682 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:32.682 INFO:teuthology.orchestra.run.smithi160.stdout:Total 206 kB/s | 85 kB 00:00 2024-05-09T12:19:32.682 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:32.690 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:32.690 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:32.754 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:32.754 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:32.903 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:33.004 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:33.138 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-mirror-19.0.0-3575.g720f8e95.el9.x86_64.rpm 2.7 MB/s | 3.1 MB 00:01 2024-05-09T12:19:33.139 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:33.139 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.7 MB/s | 3.1 MB 00:01 2024-05-09T12:19:33.139 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:33.148 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:33.149 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:33.230 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:33.230 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:33.362 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:33.451 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-mirror-19.0.0-3575.g720f8e95.el9.x86_64.rpm 3.6 MB/s | 3.1 MB 00:00 2024-05-09T12:19:33.452 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:33.452 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.6 MB/s | 3.1 MB 00:00 2024-05-09T12:19:33.453 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:33.463 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:33.463 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:33.547 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:33.547 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:33.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:33.600 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:33.600 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:33.601 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:33.663 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:33.722 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:33.748 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:33.840 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-mirror 2024-05-09T12:19:33.984 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:34.044 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:34.070 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:34.432 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:59 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:34.562 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 3.1 M 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:34.563 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 3.1 M 2024-05-09T12:19:34.564 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 13 M 2024-05-09T12:19:34.564 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:34.781 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:35.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-nbd 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:35.180 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:35.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-nbd 2024-05-09T12:19:35.595 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:02:01 ago on Thu 09 May 2024 12:17:34 PM UTC. 2024-05-09T12:19:35.721 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 171 k 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:35.722 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 171 k 2024-05-09T12:19:35.723 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 494 k 2024-05-09T12:19:35.723 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-05-09T12:19:36.015 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:58 ago on Thu 09 May 2024 12:17:38 PM UTC. 2024-05-09T12:19:36.140 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:19:36.141 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:36.142 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:36.142 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-09T12:19:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 171 k 2024-05-09T12:19:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:36.142 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 171 k 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 494 k 2024-05-09T12:19:36.143 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-09T12:19:36.450 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-nbd-19.0.0-3575.g720f8e95.el9.x86_64.rpm 234 kB/s | 171 kB 00:00 2024-05-09T12:19:36.451 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:36.451 INFO:teuthology.orchestra.run.smithi188.stdout:Total 234 kB/s | 171 kB 00:00 2024-05-09T12:19:36.451 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:19:36.460 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:19:36.460 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:19:36.524 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:19:36.524 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:19:36.799 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:19:36.799 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:36.913 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-nbd-19.0.0-3575.g720f8e95.el9.x86_64.rpm 221 kB/s | 171 kB 00:00 2024-05-09T12:19:36.913 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:36.914 INFO:teuthology.orchestra.run.smithi135.stdout:Total 221 kB/s | 171 kB 00:00 2024-05-09T12:19:36.914 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:19:36.923 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:19:36.923 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:19:36.988 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:19:36.988 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:19:37.151 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:19:37.199 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:37.236 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:37.442 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-05-09T12:19:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:37.442 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:37.443 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:19:37.677 DEBUG:teuthology.parallel:result is None 2024-05-09T12:19:37.709 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:37.962 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-09T12:19:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:37.963 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:19:38.195 DEBUG:teuthology.parallel:result is None 2024-05-09T12:19:38.475 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-mirror-19.0.0-3575.g720f8e95.el9.x86_64.rpm 809 kB/s | 3.1 MB 00:03 2024-05-09T12:19:38.476 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:Total 809 kB/s | 3.1 MB 00:03 2024-05-09T12:19:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:38.488 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:38.488 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:38.574 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:38.574 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:39.003 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:39.076 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T12:19:39.103 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:40.184 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:40.422 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-nbd 2024-05-09T12:19:41.004 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:02:06 ago on Thu 09 May 2024 12:17:35 PM UTC. 2024-05-09T12:19:41.128 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 ceph 171 k 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 171 k 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 494 k 2024-05-09T12:19:41.129 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-09T12:19:41.746 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-nbd-19.0.0-3575.g720f8e95.el9.x86_64.rpm 277 kB/s | 171 kB 00:00 2024-05-09T12:19:41.747 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-09T12:19:41.747 INFO:teuthology.orchestra.run.smithi160.stdout:Total 276 kB/s | 171 kB 00:00 2024-05-09T12:19:41.747 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:19:41.755 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:19:41.755 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:19:41.820 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:19:41.821 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:19:41.985 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:19:42.086 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:42.507 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:42.750 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:19:42.750 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:42.750 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-09T12:19:42.751 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:19:42.751 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:42.751 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:19:42.976 DEBUG:teuthology.parallel:result is None 2024-05-09T12:19:42.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:19:43.132 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T12:19:43.157 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.158 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.158 INFO:teuthology.task.install:The correct ceph version 19.0.0-3575.g720f8e95 is installed. 2024-05-09T12:19:43.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:19:43.302 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T12:19:43.324 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.324 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.324 INFO:teuthology.task.install:The correct ceph version 19.0.0-3575.g720f8e95 is installed. 2024-05-09T12:19:43.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=720f8e954cd9c4d6163a1fee379f1c286b4f5c7e 2024-05-09T12:19:43.551 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T12:19:43.577 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.577 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3575.g720f8e95.el9 2024-05-09T12:19:43.577 INFO:teuthology.task.install:The correct ceph version 19.0.0-3575.g720f8e95 is installed. 2024-05-09T12:19:43.579 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T12:19:43.579 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:43.579 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T12:19:43.610 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:43.610 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T12:19:43.636 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:43.637 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T12:19:43.668 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T12:19:43.668 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:43.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T12:19:43.697 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T12:19:43.764 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:43.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T12:19:43.789 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T12:19:43.854 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:43.854 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T12:19:43.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T12:19:43.954 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T12:19:43.954 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:43.954 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T12:19:43.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T12:19:44.050 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:44.051 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T12:19:44.076 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T12:19:44.140 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:44.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T12:19:44.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T12:19:44.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T12:19:44.240 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:44.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T12:19:44.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T12:19:44.339 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:44.339 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T12:19:44.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T12:19:44.431 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:44.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T12:19:44.461 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T12:19:44.530 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T12:19:44.637 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T12:19:44.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-05-09T12:19:44.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-05-09T12:19:44.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-05-09T12:19:44.670 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T12:19:44.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T12:19:44.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T12:19:44.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T12:19:44.742 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T12:19:44.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T12:19:44.781 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T12:19:44.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T12:19:44.816 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T12:19:44.816 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T12:19:44.816 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T12:19:44.816 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:44.816 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T12:19:44.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:44.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:45.003 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:45.003 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T12:19:45.018 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:45.129 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:45.155 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:45.156 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T12:19:45.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:45.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T12:19:45.361 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T12:19:45.361 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T12:19:45.362 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569', 'branch': 'main', 'description': 'smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7699569', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'e789e13b84d622c44a76f34b06dedf79bf4b7d36'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'], ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'], ['client.0']], 'seed': 8443, 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'smoke', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_e789e13b84d622c44a76f34b06dedf79bf4b7d36/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'e789e13b84d622c44a76f34b06dedf79bf4b7d36', 'targets': {'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFuFHqjlS7YAd2Q4X3ptBhIQHwOydAho8SsW6KVQTme7/BoWEKkR2HWjog9UbMTt/p1ZoJDXqdKCorZ/83SWfY=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuE9iU8mBVHjV/kH4tblm3t1lpvvC2yP8JFaa/tkNIn056DncEY/OYPENma1LQRISV8xlYBVljZjzVVOFD1s5A=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLed1qIXjNc/XYNe/rcTHQJM5AAF18EONemkWFaxwK14QIRS4sHuIzP0cUnX6A0PfB1GMALrsCwhkm3v5wrhGYw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'cleanup': True, 'flavor': 'default', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e'}}, {'ceph': {'log-ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '720f8e954cd9c4d6163a1fee379f1c286b4f5c7e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-09_05:00:13', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T12:19:45.362 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T12:19:45.365 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T12:19:45.367 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T12:19:45.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T12:19:45.423 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T12:19:45.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T12:19:45.452 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:45.452 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T12:19:45.504 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T12:19:45.504 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 12:19:34.325935108 +0000 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-09 12:16:51.531509983 +0000 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-09 12:16:51.531509983 +0000 2024-05-09T12:19:45.561 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-09 12:16:51.531509983 +0000 2024-05-09T12:19:45.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T12:19:45.625 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T12:19:45.625 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T12:19:45.625 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.0002123 s, 2.4 MB/s 2024-05-09T12:19:45.627 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T12:19:45.686 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 12:19:34.326935088 +0000 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-09 12:16:51.872502985 +0000 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-09 12:16:51.872502985 +0000 2024-05-09T12:19:45.743 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-09 12:16:51.872502985 +0000 2024-05-09T12:19:45.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T12:19:45.806 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T12:19:45.807 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T12:19:45.807 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000193557 s, 2.6 MB/s 2024-05-09T12:19:45.808 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T12:19:45.864 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-09T12:19:45.919 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 12:19:34.326935088 +0000 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-09 12:16:52.214495967 +0000 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-09 12:16:52.214495967 +0000 2024-05-09T12:19:45.920 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-09 12:16:52.214495967 +0000 2024-05-09T12:19:45.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T12:19:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T12:19:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T12:19:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000244731 s, 2.1 MB/s 2024-05-09T12:19:45.984 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T12:19:46.041 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:46.097 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-09 12:19:34.326935088 +0000 2024-05-09T12:19:46.098 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-09 12:16:52.546489154 +0000 2024-05-09T12:19:46.098 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-09 12:16:52.546489154 +0000 2024-05-09T12:19:46.098 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-09 12:16:52.546489154 +0000 2024-05-09T12:19:46.098 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T12:19:46.161 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-09T12:19:46.161 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-09T12:19:46.161 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000221736 s, 2.3 MB/s 2024-05-09T12:19:46.162 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T12:19:46.219 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:46.219 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:46.219 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T12:19:46.239 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T12:19:46.239 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:46.298 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-09 12:19:39.358383854 +0000 2024-05-09T12:19:46.299 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-09 12:16:52.626410405 +0000 2024-05-09T12:19:46.299 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-09 12:16:52.626410405 +0000 2024-05-09T12:19:46.299 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-09 12:16:52.626410405 +0000 2024-05-09T12:19:46.299 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T12:19:46.366 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-09T12:19:46.366 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-09T12:19:46.366 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000276933 s, 1.8 MB/s 2024-05-09T12:19:46.368 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T12:19:46.427 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-09 12:19:39.359383840 +0000 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-09 12:16:52.977405326 +0000 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-09 12:16:52.977405326 +0000 2024-05-09T12:19:46.485 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-09 12:16:52.977405326 +0000 2024-05-09T12:19:46.486 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T12:19:46.551 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-09T12:19:46.551 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-09T12:19:46.551 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000180687 s, 2.8 MB/s 2024-05-09T12:19:46.552 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T12:19:46.609 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-09 12:19:39.359383840 +0000 2024-05-09T12:19:46.667 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-09 12:16:53.325400292 +0000 2024-05-09T12:19:46.668 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-09 12:16:53.325400292 +0000 2024-05-09T12:19:46.668 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-09 12:16:53.325400292 +0000 2024-05-09T12:19:46.668 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T12:19:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-09T12:19:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-09T12:19:46.732 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000215063 s, 2.4 MB/s 2024-05-09T12:19:46.733 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T12:19:46.790 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-09 12:19:39.359383840 +0000 2024-05-09T12:19:46.846 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-09 12:16:53.683395112 +0000 2024-05-09T12:19:46.847 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-09 12:16:53.683395112 +0000 2024-05-09T12:19:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-09 12:16:53.683395112 +0000 2024-05-09T12:19:46.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T12:19:46.910 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-09T12:19:46.910 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-09T12:19:46.910 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000215137 s, 2.4 MB/s 2024-05-09T12:19:46.911 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T12:19:46.967 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:46.968 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-05-09T12:19:46.968 INFO:tasks.ceph:Generating config... 2024-05-09T12:19:46.969 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T12:19:46.969 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T12:19:46.969 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T12:19:46.970 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T12:19:46.971 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T12:19:46.971 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T12:19:46.971 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-09T12:19:46.971 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T12:19:46.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T12:19:47.025 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T12:19:47.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T12:19:47.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T12:19:47.099 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.135'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2024-05-09T12:19:47.100 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.135,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1}} 2024-05-09T12:19:47.100 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:47.101 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T12:19:47.156 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.135 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:47.242 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:47.242 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: generated fsid c87e53f9-e7b2-4007-9931-7931693416e8 2024-05-09T12:19:47.242 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = quincy 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 0 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:fsid c87e53f9-e7b2-4007-9931-7931693416e8 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:last_changed 2024-05-09T12:19:47.244608+0000 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-09T12:19:47.244608+0000 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:min_mon_release 17 (quincy) 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:election_strategy: 1 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2024-05-09T12:19:47.243 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T12:19:47.245 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T12:19:47.260 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c87e53f9-e7b2-4007-9931-7931693416e8... 2024-05-09T12:19:47.261 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T12:19:47.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T12:19:47.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T12:19:47.343 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-05-09T12:19:47.344 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-05-09T12:19:47.345 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.346 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.135,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = c87e53f9-e7b2-4007-9931-7931693416e8 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.347 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-05-09T12:19:47.348 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-05-09T12:19:47.349 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bdev async discard = True 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bdev enable discard = True 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore allocator = bitmap 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-05-09T12:19:47.350 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: osd shutdown pgref assert = True 2024-05-09T12:19:47.351 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-09T12:19:47.352 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T12:19:47.353 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-05-09T12:19:47.354 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-05-09T12:19:47.355 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-05-09T12:19:47.356 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-09T12:19:47.356 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-09T12:19:47.356 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2024-05-09T12:19:47.356 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2024-05-09T12:19:47.356 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-09T12:19:47.357 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-05-09T12:19:47.357 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-05-09T12:19:47.357 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T12:19:47.357 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-05-09T12:19:47.357 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.358 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-05-09T12:19:47.359 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.360 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.135,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = c87e53f9-e7b2-4007-9931-7931693416e8 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.361 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.362 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-05-09T12:19:47.363 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 20 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 20 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 10 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-05-09T12:19:47.364 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: osd shutdown pgref assert = True 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-05-09T12:19:47.365 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T12:19:47.366 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-05-09T12:19:47.367 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-05-09T12:19:47.368 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-05-09T12:19:47.369 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T12:19:47.370 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.135,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = c87e53f9-e7b2-4007-9931-7931693416e8 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-05-09T12:19:47.371 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.372 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: bdev async discard = True 2024-05-09T12:19:47.373 INFO:teuthology.orchestra.run.smithi160.stdout: bdev enable discard = True 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore allocator = bitmap 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-05-09T12:19:47.374 INFO:teuthology.orchestra.run.smithi160.stdout: osd shutdown pgref assert = True 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-05-09T12:19:47.375 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T12:19:47.376 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2024-05-09T12:19:47.377 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2024-05-09T12:19:47.378 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-05-09T12:19:47.380 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T12:19:47.380 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T12:19:47.474 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T12:19:47.475 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:47.475 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T12:19:47.491 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:47.491 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T12:19:47.547 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:19:47.547 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:47.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T12:19:47.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T12:19:47.622 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:19:47.622 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:47.677 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:19:47.677 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:47.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T12:19:47.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T12:19:47.718 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:19:47.718 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:47.774 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-05-09T12:19:47.775 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:47.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T12:19:47.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T12:19:47.816 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:19:47.816 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:47.874 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T12:19:47.874 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T12:19:47.874 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T12:19:47.925 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T12:19:47.928 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T12:19:47.990 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T12:19:47.993 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T12:19:47.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T12:19:48.044 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T12:19:48.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T12:19:48.071 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T12:19:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T12:19:48.125 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T12:19:48.149 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T12:19:48.149 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T12:19:48.215 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T12:19:48.230 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T12:19:48.230 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-05-09T12:19:48.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T12:19:48.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:48.255 INFO:tasks.ceph:role: osd.0 2024-05-09T12:19:48.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:19:48.256 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T12:19:48.329 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-09T12:19:48.330 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T12:19:48.330 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T12:19:48.330 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T12:19:48.330 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T12:19:48.827 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-09T12:19:48.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-09T12:19:48.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T12:19:48.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T12:19:48.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T12:19:49.042 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:49.042 INFO:tasks.ceph:role: osd.1 2024-05-09T12:19:49.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:19:49.042 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T12:19:49.115 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T12:19:49.116 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T12:19:49.573 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-09T12:19:49.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-09T12:19:49.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T12:19:49.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T12:19:49.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:49.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.793+0000 7fcc9721f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T12:19:49.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.793+0000 7fcc9721f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T12:19:49.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.793+0000 7fcc9721f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T12:19:49.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.793+0000 7fcc9721f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T12:19:49.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.793+0000 7fcc9721f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T12:19:49.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:49.796+0000 7fcc9721f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T12:19:52.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T12:19:52.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:52.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.778+0000 7f16c98d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T12:19:52.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.778+0000 7f16c98d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T12:19:52.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.778+0000 7f16c98d9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T12:19:52.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.778+0000 7f16c98d9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T12:19:52.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.778+0000 7f16c98d9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T12:19:52.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:19:52.779+0000 7f16c98d9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T12:19:55.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T12:19:55.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T12:19:55.698 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:55.698 INFO:tasks.ceph:role: osd.2 2024-05-09T12:19:55.698 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:19:55.698 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T12:19:55.775 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T12:19:55.776 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T12:19:56.294 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-05-09T12:19:56.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-05-09T12:19:56.297 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-05-09T12:19:56.434 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T12:19:56.468 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T12:19:56.534 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-09T12:19:56.534 INFO:tasks.ceph:role: osd.3 2024-05-09T12:19:56.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:19:56.534 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T12:19:56.607 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T12:19:56.607 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T12:19:56.608 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T12:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-05-09T12:19:57.050 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-05-09T12:19:57.050 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-05-09T12:19:57.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T12:19:57.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:19:57.284 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.286+0000 7f0ed0643640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T12:19:57.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.291+0000 7f0ed0643640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T12:19:57.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.291+0000 7f0ed0643640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T12:19:57.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.291+0000 7f0ed0643640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T12:19:57.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.291+0000 7f0ed0643640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T12:19:57.290 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:19:57.292+0000 7f0ed0643640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T12:20:00.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T12:20:00.167 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:20:00.260 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.261+0000 7fd23a430640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T12:20:00.260 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.261+0000 7fd23a430640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T12:20:00.260 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.261+0000 7fd23a430640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T12:20:00.261 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.261+0000 7fd23a430640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T12:20:00.261 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.261+0000 7fd23a430640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T12:20:00.261 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:00.262+0000 7fd23a430640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T12:20:03.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T12:20:03.144 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T12:20:03.145 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:03.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T12:20:03.176 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:03.177 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T12:20:03.247 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:03.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T12:20:03.315 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:03.315 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T12:20:03.384 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:03.384 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T12:20:03.414 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:03.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T12:20:03.483 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:03.483 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T12:20:03.551 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:03.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T12:20:03.619 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:20:03.620 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T12:20:03.640 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T12:20:03.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T12:20:03.644 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T12:20:03.669 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBjvzxmelJRNxAATdOjk6r8LnrNhDnTQjRpyQ== 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBkvzxmN5TBAhAAQcSggU9dPH2dCGAYMmCioQ== 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBlvzxmajleLxAAWY5uMzbia47V4ftzxdNy4A== 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBovzxmm2B4LhAAFocYOQCjPMs55zpBwjAdmA== 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBjvzxm0q0sOxAASE4UL6Khi2RZqDlqiZ7Iqw== 2024-05-09T12:20:03.670 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBkvzxmaFBxBxAASovy8rfIdyXEeboqu0iu8w== 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBtvzxm5ugdERAAUDNv6mvWMDsLZSWvRvQg2Q== 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBwvzxmzdmdDxAAN0M0vqn2RKuITD/lDxzB6w== 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-05-09T12:20:03.671 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBkvzxmBEz2DBAAjVfDPlCMi5i9TSphS+kcEA== 2024-05-09T12:20:03.685 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBjvzxmelJRNxAATdOjk6r8LnrNhDnTQjRpyQ== 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBkvzxmN5TBAhAAQcSggU9dPH2dCGAYMmCioQ== 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBlvzxmajleLxAAWY5uMzbia47V4ftzxdNy4A== 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBovzxmm2B4LhAAFocYOQCjPMs55zpBwjAdmA== 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBjvzxm0q0sOxAASE4UL6Khi2RZqDlqiZ7Iqw== 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-05-09T12:20:03.686 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBkvzxmaFBxBxAASovy8rfIdyXEeboqu0iu8w== 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBtvzxm5ugdERAAUDNv6mvWMDsLZSWvRvQg2Q== 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBwvzxmzdmdDxAAN0M0vqn2RKuITD/lDxzB6w== 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2024-05-09T12:20:03.687 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQBkvzxmBEz2DBAAjVfDPlCMi5i9TSphS+kcEA== 2024-05-09T12:20:03.688 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T12:20:03.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T12:20:03.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T12:20:03.783 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T12:20:03.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:03.839 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:03.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:03.894 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:03.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T12:20:03.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T12:20:03.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T12:20:03.999 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T12:20:04.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:04.056 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:04.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:04.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T12:20:04.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T12:20:04.166 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T12:20:04.219 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T12:20:04.220 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T12:20:04.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T12:20:04.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T12:20:04.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T12:20:04.393 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T12:20:04.490 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T12:20:04.519 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T12:20:04.586 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T12:20:04.683 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T12:20:04.709 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:20:04.712 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T12:20:04.765 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T12:20:04.765 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T12:20:04.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T12:20:04.769 INFO:tasks.ceph.mon.a:Started 2024-05-09T12:20:04.769 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T12:20:04.769 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T12:20:04.808 INFO:tasks.ceph.mon.b:Started 2024-05-09T12:20:04.809 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T12:20:04.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T12:20:04.811 INFO:tasks.ceph.mon.c:Started 2024-05-09T12:20:04.812 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T12:20:04.812 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T12:20:04.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T12:20:04.815 INFO:tasks.ceph.mgr.x:Started 2024-05-09T12:20:04.815 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T12:20:04.815 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T12:20:04.818 INFO:tasks.ceph.mgr.y:Started 2024-05-09T12:20:04.818 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T12:20:04.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T12:20:04.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.918+0000 7fa03ecc3640 1 Processor -- start 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.918+0000 7fa03ecc3640 1 -- start start 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03ecc3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03ecc3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa038072d90 con 0x7fa03813f720 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03ecc3640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa038071600 con 0x7fa038136620 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03ecc3640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa038073b90 con 0x7fa038136a00 2024-05-09T12:20:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03d260640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa03813f720 0x7fa038141b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:60054/0 (socket says 172.21.15.135:60054) 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60494/0 (socket says 172.21.15.135:60494) 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa03d260640 1 -- 172.21.15.135:0/3267972264 learned_addr learned my addr 172.21.15.135:0/3267972264 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 -- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 msgr2=0x7fa038139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 -- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 msgr2=0x7fa038139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 --2- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T12:20:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:04.919+0000 7fa02ffff640 1 --2- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T12:20:05.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.077+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669005940 0 0) 0x7fa038072d90 con 0x7fa03813f720 2024-05-09T12:20:05.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.077+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa020003520 con 0x7fa03813f720 2024-05-09T12:20:05.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.077+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480570379 0 0) 0x7fa038071600 con 0x7fa038136620 2024-05-09T12:20:05.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.077+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa038072d90 con 0x7fa038136620 2024-05-09T12:20:05.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3296631306 0 0) 0x7fa038072d90 con 0x7fa038136620 2024-05-09T12:20:05.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 msgr2=0x7fa038139b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T12:20:05.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 --2- 172.21.15.135:0/3267972264 >> v2:172.21.15.135:3300/0 conn(0x7fa038136a00 0x7fa038139b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 >> v1:172.21.15.135:6789/0 conn(0x7fa03813f720 legacy=0x7fa038141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0380727f0 con 0x7fa038136620 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7fa0340016d0 con 0x7fa038136620 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 >> v1:172.21.15.160:6789/0 conn(0x7fa038136620 legacy=0x7fa0381393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa020003c30 0x7fa020004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa020004800 0x7fa020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa02000bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa038073b90 con 0x7fa0200099b0 2024-05-09T12:20:05.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa02000c310 con 0x7fa020004800 2024-05-09T12:20:05.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa02000e720 con 0x7fa020003c30 2024-05-09T12:20:05.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa02000bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02ffff640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa020004800 0x7fa020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03ca5f640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa020003c30 0x7fa020004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 -- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa020003c30 msgr2=0x7fa020004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:05.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa020003c30 0x7fa020004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 -- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa020004800 msgr2=0x7fa020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa020004800 0x7fa020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa03d260640 1 -- 172.21.15.135:0/3267972264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa038072d90 con 0x7fa0200099b0 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.078+0000 7fa02ffff640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa020004800 0x7fa020004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.079+0000 7fa03d260640 1 -- 172.21.15.135:0/3267972264 reap_dead start 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.079+0000 7fa03d260640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa02000bda0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa03000c4c0 tx=0x7fa020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0797e354eb6f03d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.079+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02800b5e0 con 0x7fa0200099b0 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.079+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa030030070 con 0x7fa0200099b0 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.079+0000 7fa02f7fe640 1 -- 172.21.15.135:0/3267972264 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03000c0e0 con 0x7fa0200099b0 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 -- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 msgr2=0x7fa02000bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa02000bda0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa03000c4c0 tx=0x7fa020005830 comp rx=0 tx=0).stop 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 -- 172.21.15.135:0/3267972264 shutdown_connections 2024-05-09T12:20:05.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/3267972264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa02000bda0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 -- 172.21.15.135:0/3267972264 >> 172.21.15.135:0/3267972264 conn(0x7fa0380aa930 msgr2=0x7fa0380aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 -- 172.21.15.135:0/3267972264 shutdown_connections 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.080+0000 7fa03ecc3640 1 -- 172.21.15.135:0/3267972264 wait complete. 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.081+0000 7fa03ecc3640 1 Processor -- start 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.081+0000 7fa03ecc3640 1 -- start start 2024-05-09T12:20:05.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa038133930 0x7fa0381cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 0x7fa0381ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa038136e60 con 0x7fa0200099b0 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa038073970 con 0x7fa038133930 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ecc3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa0380740a0 con 0x7fa0381cdf50 2024-05-09T12:20:05.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60526/0 (socket says 172.21.15.135:60526) 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 -- 172.21.15.135:0/375626961 learned_addr learned my addr 172.21.15.135:0/375626961 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa02ffff640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa038133930 0x7fa0381cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03d260640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 0x7fa0381ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 -- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 msgr2=0x7fa0381ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 0x7fa0381ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 -- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa038133930 msgr2=0x7fa0381cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa038133930 0x7fa0381cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03ca5f640 1 -- 172.21.15.135:0/375626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0380a7fa0 con 0x7fa0200099b0 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.082+0000 7fa03d260640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 0x7fa0381ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa03ca5f640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa03400f820 tx=0x7fa03400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0340052e0 con 0x7fa0200099b0 2024-05-09T12:20:05.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa034018070 con 0x7fa0200099b0 2024-05-09T12:20:05.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03809e5b0 con 0x7fa0200099b0 2024-05-09T12:20:05.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03400d910 con 0x7fa0200099b0 2024-05-09T12:20:05.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0380a0300 con 0x7fa0200099b0 2024-05-09T12:20:05.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa03400dab0 con 0x7fa0200099b0 2024-05-09T12:20:05.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.083+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa03401d460 con 0x7fa0200099b0 2024-05-09T12:20:05.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.084+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0380508d0 con 0x7fa0200099b0 2024-05-09T12:20:05.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.086+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa0340035f0 con 0x7fa0200099b0 2024-05-09T12:20:05.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.151+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa038071600 con 0x7fa0200099b0 2024-05-09T12:20:05.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.153+0000 7fa02d7fa640 1 -- 172.21.15.135:0/375626961 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa0340037d0 con 0x7fa0200099b0 2024-05-09T12:20:05.152 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 msgr2=0x7fa0381333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa03400f820 tx=0x7fa03400fce0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 shutdown_connections 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0381cdf50 0x7fa0381ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa038133930 0x7fa0381cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 --2- 172.21.15.135:0/375626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200099b0 0x7fa0381333f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 >> 172.21.15.135:0/375626961 conn(0x7fa0380aa930 msgr2=0x7fa0380a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 shutdown_connections 2024-05-09T12:20:05.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:05.154+0000 7fa03ecc3640 1 -- 172.21.15.135:0/375626961 wait complete. 2024-05-09T12:20:05.164 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T12:20:05.164 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T12:20:05.164 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:05.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T12:20:05.189 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-09T12:20:05.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T12:20:05.193 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:05.194+0000 7f247d893040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T12:20:05.202 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:05.203+0000 7f560c00e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T12:20:05.216 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:05.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T12:20:05.242 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-09T12:20:05.242 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T12:20:05.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 5341ef1f-315c-46db-b1b7-80aceff3242c 0 2024-05-09T12:20:05.355 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:05.356+0000 7f247d893040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T12:20:05.365 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:05.367+0000 7f560c00e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T12:20:05.409 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:05.410+0000 7f247d893040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T12:20:05.422 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:05.423+0000 7f560c00e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T12:20:05.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.451+0000 7f52a2aee640 1 Processor -- start 2024-05-09T12:20:05.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a2aee640 1 -- start start 2024-05-09T12:20:05.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a2aee640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f529c141300 0x7f529c1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a2aee640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c09d4c0 con 0x7f529c13d7f0 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a2aee640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c09e820 con 0x7f529c09da60 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a2aee640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f529c09d2a0 con 0x7f529c141300 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a088a640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f529c09da60 0x7f529c09de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36652/0 (socket says 172.21.15.160:36652) 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a088a640 1 -- 172.21.15.160:0/925367455 learned_addr learned my addr 172.21.15.160:0/925367455 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f52a108b640 1 --2- 172.21.15.160:0/925367455 >> v2:172.21.15.135:3300/0 conn(0x7f529c141300 0x7f529c1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204276252 0 0) 0x7f529c09e820 con 0x7f529c09da60 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.452+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f528c003520 con 0x7f529c09da60 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f52a108b640 1 -- 172.21.15.160:0/925367455 >> v1:172.21.15.160:6789/0 conn(0x7f529c09da60 legacy=0x7f529c09de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f52a108b640 1 -- 172.21.15.160:0/925367455 >> v1:172.21.15.135:6789/0 conn(0x7f529c13d7f0 legacy=0x7f529c13fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311663407 0 0) 0x7f5288001110 con 0x7f529c13d7f0 2024-05-09T12:20:05.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f52a108b640 1 -- 172.21.15.160:0/925367455 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c09c1c0 con 0x7f529c141300 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f52a108b640 1 --2- 172.21.15.160:0/925367455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c141300 0x7f529c1436f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5294009d90 tx=0x7f529402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b78d77ecaf0e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.453+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294039070 con 0x7f529c141300 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529402cbd0 con 0x7f529c141300 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f529b7fe640 1 -- 172.21.15.160:0/925367455 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294034440 con 0x7f529c141300 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 -- 172.21.15.160:0/925367455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c141300 msgr2=0x7f529c1436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 --2- 172.21.15.160:0/925367455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c141300 0x7f529c1436f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5294009d90 tx=0x7f529402be20 comp rx=0 tx=0).stop 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 -- 172.21.15.160:0/925367455 shutdown_connections 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 --2- 172.21.15.160:0/925367455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c141300 0x7f529c1436f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 -- 172.21.15.160:0/925367455 >> 172.21.15.160:0/925367455 conn(0x7f529c075d90 msgr2=0x7f529c0aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 -- 172.21.15.160:0/925367455 shutdown_connections 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.454+0000 7f52a2aee640 1 -- 172.21.15.160:0/925367455 wait complete. 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.455+0000 7f52a2aee640 1 Processor -- start 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.455+0000 7f52a2aee640 1 -- start start 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 0x7f529c1d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 0x7f529c1d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f529c09d080 con 0x7f529c13d7f0 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f529c09b180 con 0x7f529c141300 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a2aee640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f529c09bf00 con 0x7f529c09da60 2024-05-09T12:20:05.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a108b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 0x7f529c1d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50344/0 (socket says 172.21.15.160:50344) 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 -- 172.21.15.160:0/919165289 learned_addr learned my addr 172.21.15.160:0/919165289 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f529bfff640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 0x7f529c1d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 -- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 msgr2=0x7f529c1d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 0x7f529c1d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 -- 172.21.15.160:0/919165289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 msgr2=0x7f529c1d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 0x7f529c1d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 -- 172.21.15.160:0/919165289 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c13bec0 con 0x7f529c09da60 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a108b640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 0x7f529c1d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f529bfff640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 0x7f529c1d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.456+0000 7f52a088a640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f529000c430 tx=0x7f529000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.458 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290017070 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5290005ce0 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c13cdc0 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52900072d0 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c0a2b10 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f529001a070 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.457+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5290012740 con 0x7f529c09da60 2024-05-09T12:20:05.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.458+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c13d4c0 con 0x7f529c09da60 2024-05-09T12:20:05.460 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.460+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f529c13d4c0 con 0x7f529c09da60 2024-05-09T12:20:05.531 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.532+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5341ef1f-315c-46db-b1b7-80aceff3242c", "id": 0} v 0) -- 0x7f529c06a680 con 0x7f529c09da60 2024-05-09T12:20:05.534 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.536+0000 7f52997fa640 1 -- 172.21.15.160:0/919165289 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5341ef1f-315c-46db-b1b7-80aceff3242c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f529c13bec0 con 0x7f529c09da60 2024-05-09T12:20:05.534 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-05-09T12:20:05.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 msgr2=0x7f529c1cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f529000c430 tx=0x7f529000c8f0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 shutdown_connections 2024-05-09T12:20:05.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f529c141300 0x7f529c1d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f529c13d7f0 0x7f529c1d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 --2- 172.21.15.160:0/919165289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f529c09da60 0x7f529c1cfc40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 >> 172.21.15.160:0/919165289 conn(0x7f529c075d90 msgr2=0x7f529c0aa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 shutdown_connections 2024-05-09T12:20:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.537+0000 7f52a2aee640 1 -- 172.21.15.160:0/919165289 wait complete. 2024-05-09T12:20:05.545 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c 1 2024-05-09T12:20:05.671 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:05.672+0000 7f247d893040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T12:20:05.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.687+0000 7f7b58e27640 1 Processor -- start 2024-05-09T12:20:05.686 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.687+0000 7f7b58e27640 1 -- start start 2024-05-09T12:20:05.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b58e27640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b58e27640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 0x7f7b54141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.687 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b58e27640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54071be0 con 0x7f7b54136390 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b58e27640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5409df70 con 0x7f7b5413f110 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b58e27640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7b54071310 con 0x7f7b5413c7e0 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b52d9d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 0x7f7b54141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50354/0 (socket says 172.21.15.160:50354) 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 -- 172.21.15.160:0/4091503106 learned_addr learned my addr 172.21.15.160:0/4091503106 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 -- 172.21.15.160:0/4091503106 >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 msgr2=0x7f7b54141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 --2- 172.21.15.160:0/4091503106 >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 0x7f7b54141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.688+0000 7f7b51d9b640 1 -- 172.21.15.160:0/4091503106 >> v1:172.21.15.135:6789/0 conn(0x7f7b54136390 legacy=0x7f7b54136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b51d9b640 1 -- 172.21.15.160:0/4091503106 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b54072aa0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b52d9d640 1 --2- 172.21.15.160:0/4091503106 >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 0x7f7b54141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.688 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b51d9b640 1 --2- 172.21.15.160:0/4091503106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b4802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2b8adb18a848b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b5159a640 1 -- 172.21.15.160:0/4091503106 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48035020 con 0x7f7b5413c7e0 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b5159a640 1 -- 172.21.15.160:0/4091503106 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48031640 con 0x7f7b5413c7e0 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.689+0000 7f7b5159a640 1 -- 172.21.15.160:0/4091503106 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4802d040 con 0x7f7b5413c7e0 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 -- 172.21.15.160:0/4091503106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 msgr2=0x7f7b5413ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 --2- 172.21.15.160:0/4091503106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009870 tx=0x7f7b4802b8f0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 -- 172.21.15.160:0/4091503106 shutdown_connections 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 --2- 172.21.15.160:0/4091503106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b5413c7e0 0x7f7b5413ebd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 --2- 172.21.15.160:0/4091503106 >> v2:172.21.15.160:3300/0 conn(0x7f7b5413f110 0x7f7b54141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 -- 172.21.15.160:0/4091503106 >> 172.21.15.160:0/4091503106 conn(0x7f7b540aba90 msgr2=0x7f7b540abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.690 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 -- 172.21.15.160:0/4091503106 shutdown_connections 2024-05-09T12:20:05.691 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.690+0000 7f7b58e27640 1 -- 172.21.15.160:0/4091503106 wait complete. 2024-05-09T12:20:05.691 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.691+0000 7f7b58e27640 1 Processor -- start 2024-05-09T12:20:05.691 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.691+0000 7f7b58e27640 1 -- start start 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 0x7f7b541d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5413f110 0x7f7b541d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5409d860 con 0x7f7b5413f110 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540742b0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b58e27640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7b54071920 con 0x7f7b54136390 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b5259c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 0x7f7b541d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.693 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55978/0 (socket says 172.21.15.160:55978) 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b5259c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 0x7f7b541d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50368/0 (socket says 172.21.15.160:50368) 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 -- 172.21.15.160:0/1344897312 learned_addr learned my addr 172.21.15.160:0/1344897312 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b52d9d640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5413f110 0x7f7b541d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 -- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 msgr2=0x7f7b541d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 0x7f7b541d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 -- 172.21.15.160:0/1344897312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5413f110 msgr2=0x7f7b541d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5413f110 0x7f7b541d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 -- 172.21.15.160:0/1344897312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5413c350 con 0x7f7b5413c7e0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.692+0000 7f7b51d9b640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000c00 tx=0x7f7b480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48040070 con 0x7f7b5413c7e0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b480399f0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b540a65a0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.694 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48035040 con 0x7f7b5413c7e0 2024-05-09T12:20:05.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b540a6b20 con 0x7f7b5413c7e0 2024-05-09T12:20:05.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b48038020 con 0x7f7b5413c7e0 2024-05-09T12:20:05.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.693+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7b48044400 con 0x7f7b5413c7e0 2024-05-09T12:20:05.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.694+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b540508d0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.695 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.696+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7b48039dc0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.698 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:05.699+0000 7f560c00e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T12:20:05.717 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:05.718+0000 7f247d893040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T12:20:05.743 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:05.745+0000 7f560c00e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T12:20:05.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.767+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c", "id": 1} v 0) -- 0x7f7b5406d8f0 con 0x7f7b5413c7e0 2024-05-09T12:20:05.768 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.770+0000 7f7b42ffd640 1 -- 172.21.15.160:0/1344897312 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f7b4803a420 con 0x7f7b5413c7e0 2024-05-09T12:20:05.769 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 msgr2=0x7f7b541d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b48000c00 tx=0x7f7b480046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 shutdown_connections 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b5413f110 0x7f7b541d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b5413c7e0 0x7f7b541d2170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 --2- 172.21.15.160:0/1344897312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b54136390 0x7f7b541d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 >> 172.21.15.160:0/1344897312 conn(0x7f7b540aba90 msgr2=0x7f7b5406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 shutdown_connections 2024-05-09T12:20:05.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.771+0000 7f7b58e27640 1 -- 172.21.15.160:0/1344897312 wait complete. 2024-05-09T12:20:05.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 664ff7e7-89aa-4166-9a00-02a74c0e4e34 2 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 Processor -- start 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 -- start start 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce500a4640 0x7fce5013e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce500a5890 con 0x7fce5013ed50 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce500a4c50 con 0x7fce50133330 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce57193640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce500a5b30 con 0x7fce500a4640 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce54f2f640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fce50133330 0x7fce50133710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36668/0 (socket says 172.21.15.160:36668) 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce54f2f640 1 -- 172.21.15.160:0/926703951 learned_addr learned my addr 172.21.15.160:0/926703951 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-05-09T12:20:05.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.882+0000 7fce4ffff640 1 --2- 172.21.15.160:0/926703951 >> v2:172.21.15.135:3300/0 conn(0x7fce500a4640 0x7fce5013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715340157 0 0) 0x7fce500a4c50 con 0x7fce50133330 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce40003520 con 0x7fce50133330 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717721091 0 0) 0x7fce500a5890 con 0x7fce5013ed50 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce500a4c50 con 0x7fce5013ed50 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4ffff640 1 -- 172.21.15.160:0/926703951 >> v1:172.21.15.160:6789/0 conn(0x7fce50133330 legacy=0x7fce50133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4ffff640 1 -- 172.21.15.160:0/926703951 >> v1:172.21.15.135:6789/0 conn(0x7fce5013ed50 legacy=0x7fce50141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.883+0000 7fce4ffff640 1 -- 172.21.15.160:0/926703951 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500a3dc0 con 0x7fce500a4640 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce4ffff640 1 --2- 172.21.15.160:0/926703951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5013e810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0097a0 tx=0x7fce3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf0a322e10c6d3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0315a0 con 0x7fce500a4640 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c037070 con 0x7fce500a4640 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce4f7fe640 1 -- 172.21.15.160:0/926703951 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3c031960 con 0x7fce500a4640 2024-05-09T12:20:05.888 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 -- 172.21.15.160:0/926703951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 msgr2=0x7fce5013e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 --2- 172.21.15.160:0/926703951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5013e810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0097a0 tx=0x7fce3c02b840 comp rx=0 tx=0).stop 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 -- 172.21.15.160:0/926703951 shutdown_connections 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 --2- 172.21.15.160:0/926703951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5013e810 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 -- 172.21.15.160:0/926703951 >> 172.21.15.160:0/926703951 conn(0x7fce500a87a0 msgr2=0x7fce500ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 -- 172.21.15.160:0/926703951 shutdown_connections 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.884+0000 7fce57193640 1 -- 172.21.15.160:0/926703951 wait complete. 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.885+0000 7fce57193640 1 Processor -- start 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.885+0000 7fce57193640 1 -- start start 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 0x7fce5006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce5009f390 con 0x7fce500a4640 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fce500a4f10 con 0x7fce5013ed50 2024-05-09T12:20:05.889 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce57193640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fce500ac030 con 0x7fce50133330 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce4ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 0x7fce5006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55990/0 (socket says 172.21.15.160:55990) 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 -- 172.21.15.160:0/1972919140 learned_addr learned my addr 172.21.15.160:0/1972919140 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce54f2f640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 -- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 msgr2=0x7fce5006c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 0x7fce5006c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 -- 172.21.15.160:0/1972919140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 msgr2=0x7fce5006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5006c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce55730640 1 -- 172.21.15.160:0/1972919140 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5009de50 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce54f2f640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.886+0000 7fce4ffff640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 0x7fce5006c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce55730640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c710 tx=0x7fce4800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48003b70 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce48003d10 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800aa50 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5009da80 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5009b530 con 0x7fce5013ed50 2024-05-09T12:20:05.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce4800abf0 con 0x7fce5013ed50 2024-05-09T12:20:05.892 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.887+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fce48012890 con 0x7fce5013ed50 2024-05-09T12:20:05.892 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.888+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce500508d0 con 0x7fce5013ed50 2024-05-09T12:20:05.892 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.890+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fce5009de50 con 0x7fce5013ed50 2024-05-09T12:20:05.961 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.963+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "664ff7e7-89aa-4166-9a00-02a74c0e4e34", "id": 2} v 0) -- 0x7fce500a3650 con 0x7fce5013ed50 2024-05-09T12:20:05.967 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.968+0000 7fce4d7fa640 1 -- 172.21.15.160:0/1972919140 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "664ff7e7-89aa-4166-9a00-02a74c0e4e34", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fce48012470 con 0x7fce5013ed50 2024-05-09T12:20:05.967 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 msgr2=0x7fce5006cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c710 tx=0x7fce4800cbd0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 shutdown_connections 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce5013ed50 0x7fce5006cb50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce50133330 0x7fce5006c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.969 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 --2- 172.21.15.160:0/1972919140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce500a4640 0x7fce5006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:05.970 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 >> 172.21.15.160:0/1972919140 conn(0x7fce500a87a0 msgr2=0x7fce501328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:05.970 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 shutdown_connections 2024-05-09T12:20:05.970 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:05.969+0000 7fce57193640 1 -- 172.21.15.160:0/1972919140 wait complete. 2024-05-09T12:20:05.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0 3 2024-05-09T12:20:06.084 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.083+0000 7f53db683640 1 Processor -- start 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 -- start start 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53d409ba70 0x7f53d413ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d409d720 con 0x7f53d409d270 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f53d409ed30 con 0x7f53d409ba70 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53db683640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f53d409c0f0 con 0x7f53d4134400 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53d941f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53d941f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:50378/0 (socket says 172.21.15.160:50378) 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53d8c1e640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f53d409d270 0x7f53d413a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:36674/0 (socket says 172.21.15.160:36674) 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53d941f640 1 -- 172.21.15.160:0/3840427179 learned_addr learned my addr 172.21.15.160:0/3840427179 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53d9c20640 1 --2- 172.21.15.160:0/3840427179 >> v2:172.21.15.135:3300/0 conn(0x7f53d409ba70 0x7f53d413ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.084+0000 7f53cbfff640 1 -- 172.21.15.160:0/3840427179 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825812692 0 0) 0x7f53d409d720 con 0x7f53d409d270 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53cbfff640 1 -- 172.21.15.160:0/3840427179 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53c0003520 con 0x7f53d409d270 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53d941f640 1 -- 172.21.15.160:0/3840427179 >> v2:172.21.15.135:3300/0 conn(0x7f53d409ba70 msgr2=0x7f53d413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53d941f640 1 --2- 172.21.15.160:0/3840427179 >> v2:172.21.15.135:3300/0 conn(0x7f53d409ba70 0x7f53d413ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53d941f640 1 -- 172.21.15.160:0/3840427179 >> v1:172.21.15.160:6789/0 conn(0x7f53d409d270 legacy=0x7f53d413a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53d941f640 1 -- 172.21.15.160:0/3840427179 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d409b390 con 0x7f53d4134400 2024-05-09T12:20:06.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53d941f640 1 --2- 172.21.15.160:0/3840427179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009870 tx=0x7f53c402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49332588d4ff04a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.089 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53cbfff640 1 -- 172.21.15.160:0/3840427179 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40317c0 con 0x7f53d4134400 2024-05-09T12:20:06.089 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53cbfff640 1 -- 172.21.15.160:0/3840427179 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c4037070 con 0x7f53d4134400 2024-05-09T12:20:06.089 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.085+0000 7f53cbfff640 1 -- 172.21.15.160:0/3840427179 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4031b80 con 0x7f53d4134400 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 -- 172.21.15.160:0/3840427179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 msgr2=0x7f53d41347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 --2- 172.21.15.160:0/3840427179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009870 tx=0x7f53c402b860 comp rx=0 tx=0).stop 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 -- 172.21.15.160:0/3840427179 shutdown_connections 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 --2- 172.21.15.160:0/3840427179 >> v2:172.21.15.135:3300/0 conn(0x7f53d409ba70 0x7f53d413ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 --2- 172.21.15.160:0/3840427179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41347e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.086+0000 7f53db683640 1 -- 172.21.15.160:0/3840427179 >> 172.21.15.160:0/3840427179 conn(0x7f53d40ac8c0 msgr2=0x7f53d40accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.087+0000 7f53db683640 1 -- 172.21.15.160:0/3840427179 shutdown_connections 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.087+0000 7f53db683640 1 -- 172.21.15.160:0/3840427179 wait complete. 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.087+0000 7f53db683640 1 Processor -- start 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.087+0000 7f53db683640 1 -- start start 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d409d270 0x7f53d4133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.090 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4134d20 con 0x7f53d409d270 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4074980 con 0x7f53d409ba70 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53db683640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40a25d0 con 0x7f53d4134400 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d9c20640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:55994/0 (socket says 172.21.15.160:55994) 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 -- 172.21.15.160:0/1381259342 learned_addr learned my addr 172.21.15.160:0/1381259342 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d8c1e640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d409d270 0x7f53d4133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 -- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 msgr2=0x7f53d41cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 -- 172.21.15.160:0/1381259342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d409d270 msgr2=0x7f53d4133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d409d270 0x7f53d4133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d941f640 1 -- 172.21.15.160:0/1381259342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40a1e90 con 0x7f53d409ba70 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.088+0000 7f53d9c20640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:06.091 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53d941f640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53c402b8a0 tx=0x7f53c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4032650 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c40327f0 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4032be0 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d40a2310 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d4133e50 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53c404c060 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.089+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f53c4045880 con 0x7f53d409ba70 2024-05-09T12:20:06.092 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.090+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d40732b0 con 0x7f53d409ba70 2024-05-09T12:20:06.093 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.094+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f53c4064ec0 con 0x7f53d409ba70 2024-05-09T12:20:06.166 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.166+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0", "id": 3} v 0) -- 0x7f53d40a2130 con 0x7f53d409ba70 2024-05-09T12:20:06.171 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.172+0000 7f53c9ffb640 1 -- 172.21.15.160:0/1381259342 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f53d40a2130 con 0x7f53d409ba70 2024-05-09T12:20:06.171 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-05-09T12:20:06.172 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 msgr2=0x7f53d41333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53c402b8a0 tx=0x7f53c40046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 shutdown_connections 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53d4134400 0x7f53d41cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53d409d270 0x7f53d4133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 --2- 172.21.15.160:0/1381259342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53d409ba70 0x7f53d41333d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 >> 172.21.15.160:0/1381259342 conn(0x7f53d40ac8c0 msgr2=0x7f53d41bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 shutdown_connections 2024-05-09T12:20:06.173 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-09T12:20:06.173+0000 7f53db683640 1 -- 172.21.15.160:0/1381259342 wait complete. 2024-05-09T12:20:06.183 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T12:20:06.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T12:20:06.186 INFO:tasks.ceph.osd.0:Started 2024-05-09T12:20:06.186 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T12:20:06.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T12:20:06.188 INFO:tasks.ceph.osd.1:Started 2024-05-09T12:20:06.188 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T12:20:06.188 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T12:20:06.191 INFO:tasks.ceph.osd.2:Started 2024-05-09T12:20:06.191 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T12:20:06.191 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T12:20:06.193 INFO:tasks.ceph.osd.3:Started 2024-05-09T12:20:06.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:06.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.299+0000 7f843464c640 1 Processor -- start 2024-05-09T12:20:06.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.300+0000 7f843464c640 1 -- start start 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.300+0000 7f843464c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f842c0ab090 0x7f842c0a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.300+0000 7f843464c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0a2b70 con 0x7f842c0aa5a0 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.300+0000 7f843464c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0a3a40 con 0x7f842c1422f0 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.300+0000 7f843464c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0a5ba0 con 0x7f842c0ab090 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f84323e8640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f842c0aa5a0 0x7f842c0aa980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:60058/0 (socket says 172.21.15.135:60058) 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f84323e8640 1 -- 172.21.15.135:0/2583854794 learned_addr learned my addr 172.21.15.135:0/2583854794 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:06.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f8431be7640 1 --2- 172.21.15.135:0/2583854794 >> v2:172.21.15.160:3300/0 conn(0x7f842c0ab090 0x7f842c0a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785982107 0 0) 0x7f842c0a2b70 con 0x7f842c0aa5a0 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8418003520 con 0x7f842c0aa5a0 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f8431be7640 1 -- 172.21.15.135:0/2583854794 >> v1:172.21.15.160:6789/0 conn(0x7f842c1422f0 legacy=0x7f842c1446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553590039 0 0) 0x7f8418003520 con 0x7f842c0aa5a0 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f8431be7640 1 -- 172.21.15.135:0/2583854794 >> v1:172.21.15.135:6789/0 conn(0x7f842c0aa5a0 legacy=0x7f842c0aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.301+0000 7f8431be7640 1 -- 172.21.15.135:0/2583854794 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0a2ea0 con 0x7f842c0ab090 2024-05-09T12:20:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.302+0000 7f8431be7640 1 --2- 172.21.15.135:0/2583854794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c0a4c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84280097a0 tx=0x7f842802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd0bbbd9a693f94 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.302+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428037070 con 0x7f842c0ab090 2024-05-09T12:20:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.302+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8428030510 con 0x7f842c0ab090 2024-05-09T12:20:06.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.302+0000 7f84313e6640 1 -- 172.21.15.135:0/2583854794 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c001710 con 0x7f842c0ab090 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 -- 172.21.15.135:0/2583854794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 msgr2=0x7f842c0a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 --2- 172.21.15.135:0/2583854794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c0a4c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f84280097a0 tx=0x7f842802b710 comp rx=0 tx=0).stop 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 -- 172.21.15.135:0/2583854794 shutdown_connections 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 --2- 172.21.15.135:0/2583854794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c0a4c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 -- 172.21.15.135:0/2583854794 >> 172.21.15.135:0/2583854794 conn(0x7f842c0a87a0 msgr2=0x7f842c0ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 -- 172.21.15.135:0/2583854794 shutdown_connections 2024-05-09T12:20:06.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.303+0000 7f843464c640 1 -- 172.21.15.135:0/2583854794 wait complete. 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 Processor -- start 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 -- start start 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f842c0aa5a0 0x7f842c13e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c13e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0ac030 con 0x7f842c1422f0 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0a3d00 con 0x7f842c0ab090 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f843464c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0ac1b0 con 0x7f842c0aa5a0 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f8432be9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f8432be9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60562/0 (socket says 172.21.15.135:60562) 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f8432be9640 1 -- 172.21.15.135:0/1747821190 learned_addr learned my addr 172.21.15.135:0/1747821190 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:06.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f8431be7640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.304+0000 7f84323e8640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f842c0aa5a0 0x7f842c13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 -- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f842c0aa5a0 msgr2=0x7f842c13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f842c0aa5a0 0x7f842c13e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 -- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 msgr2=0x7f842c13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c13e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 -- 172.21.15.135:0/1747821190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c141d20 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8431be7640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c13e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8432be9640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f842400c730 tx=0x7f842400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424003b70 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8424003d10 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c13f530 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842400aa70 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c140740 con 0x7f842c1422f0 2024-05-09T12:20:06.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f842400ac10 con 0x7f842c1422f0 2024-05-09T12:20:06.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.305+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8424012a20 con 0x7f842c1422f0 2024-05-09T12:20:06.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.306+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c0508d0 con 0x7f842c1422f0 2024-05-09T12:20:06.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.308+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f842c141d20 con 0x7f842c1422f0 2024-05-09T12:20:06.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.369+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f842c06caf0 con 0x7f842c1422f0 2024-05-09T12:20:06.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.370+0000 7f8422ffd640 1 -- 172.21.15.135:0/1747821190 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f8424012cc0 con 0x7f842c1422f0 2024-05-09T12:20:06.369 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:06.369 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:06.169041+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 msgr2=0x7f842c13eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f842400c730 tx=0x7f842400cbf0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 shutdown_connections 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f842c1422f0 0x7f842c13eb90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f842c0ab090 0x7f842c13e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 --2- 172.21.15.135:0/1747821190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f842c0aa5a0 0x7f842c13e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 >> 172.21.15.135:0/1747821190 conn(0x7f842c0a87a0 msgr2=0x7f842c1446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 shutdown_connections 2024-05-09T12:20:06.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:06.371+0000 7f843464c640 1 -- 172.21.15.135:0/1747821190 wait complete. 2024-05-09T12:20:06.380 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T12:20:06.381 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T12:20:06.456 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.457+0000 7f247d893040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T12:20:06.506 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.507+0000 7f560c00e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T12:20:06.543 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.544+0000 7f247d893040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T12:20:06.587 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.588+0000 7f247d893040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T12:20:06.595 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.595+0000 7f560c00e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T12:20:06.637 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.637+0000 7f560c00e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T12:20:06.749 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.750+0000 7f247d893040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T12:20:06.780 INFO:tasks.ceph.osd.2.smithi160.stderr:2024-05-09T12:20:06.780+0000 7fedb01a3640 -1 Falling back to public interface 2024-05-09T12:20:06.780 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-09T12:20:06.781+0000 7fe887eac640 -1 Falling back to public interface 2024-05-09T12:20:06.783 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:06.791 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-09T12:20:06.792+0000 7f1cb0e0f640 -1 Falling back to public interface 2024-05-09T12:20:06.792 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-05-09T12:20:06.793+0000 7f49f8cae640 -1 Falling back to public interface 2024-05-09T12:20:06.806 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.807+0000 7f560c00e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T12:20:06.812 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.813+0000 7f247d893040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T12:20:06.854 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.855+0000 7f560c00e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T12:20:06.867 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.868+0000 7f247d893040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T12:20:06.874 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 Processor -- start 2024-05-09T12:20:06.874 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 -- start start 2024-05-09T12:20:06.875 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 0x7f3fc0139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 0x7f3fc013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fc009de90 con 0x7f3fc013cce0 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc006ca30 con 0x7f3fc009ce60 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.875+0000 7f3fc4ee6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc009d650 con 0x7f3fc0139780 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbed9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3fc013cce0 0x7f3fc0143ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:60064/0 (socket says 172.21.15.135:60064) 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbed9d640 1 -- 172.21.15.135:0/3492898791 learned_addr learned my addr 172.21.15.135:0/3492898791 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbdd9b640 1 --2- 172.21.15.135:0/3492898791 >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 0x7f3fc013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbe59c640 1 --2- 172.21.15.135:0/3492898791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 0x7f3fc0139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbd59a640 1 -- 172.21.15.135:0/3492898791 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005066493 0 0) 0x7f3fc009de90 con 0x7f3fc013cce0 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbd59a640 1 -- 172.21.15.135:0/3492898791 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa8003520 con 0x7f3fc013cce0 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbe59c640 1 -- 172.21.15.135:0/3492898791 >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 msgr2=0x7f3fc013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbe59c640 1 --2- 172.21.15.135:0/3492898791 >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 0x7f3fc013c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.876 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbe59c640 1 -- 172.21.15.135:0/3492898791 >> v1:172.21.15.135:6789/0 conn(0x7f3fc013cce0 legacy=0x7f3fc0143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.877 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbe59c640 1 -- 172.21.15.135:0/3492898791 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00a8da0 con 0x7f3fc0139780 2024-05-09T12:20:06.877 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.876+0000 7f3fbdd9b640 1 --2- 172.21.15.135:0/3492898791 >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 0x7f3fc013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.877+0000 7f3fbe59c640 1 --2- 172.21.15.135:0/3492898791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 0x7f3fc0139b60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00097a0 tx=0x7f3fb002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33883231170e4d52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.877+0000 7f3fbd59a640 1 -- 172.21.15.135:0/3492898791 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0039070 con 0x7f3fc0139780 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.877+0000 7f3fbd59a640 1 -- 172.21.15.135:0/3492898791 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb00316f0 con 0x7f3fc0139780 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.877+0000 7f3fbd59a640 1 -- 172.21.15.135:0/3492898791 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0031ac0 con 0x7f3fc0139780 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/3492898791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 msgr2=0x7f3fc0139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/3492898791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 0x7f3fc0139b60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00097a0 tx=0x7f3fb002b790 comp rx=0 tx=0).stop 2024-05-09T12:20:06.881 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/3492898791 shutdown_connections 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/3492898791 >> v2:172.21.15.160:3300/0 conn(0x7f3fc009ce60 0x7f3fc013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/3492898791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc0139780 0x7f3fc0139b60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/3492898791 >> 172.21.15.135:0/3492898791 conn(0x7f3fc0075cd0 msgr2=0x7f3fc00aba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/3492898791 shutdown_connections 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.878+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/3492898791 wait complete. 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 Processor -- start 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 -- start start 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc009ce60 0x7f3fc0134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 0x7f3fc01d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc0139230 con 0x7f3fc0139780 2024-05-09T12:20:06.882 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc009dbc0 con 0x7f3fc013cce0 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fc4ee6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc013a0a0 con 0x7f3fc009ce60 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fbdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fbdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60564/0 (socket says 172.21.15.135:60564) 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.879+0000 7f3fbdd9b640 1 -- 172.21.15.135:0/384910555 learned_addr learned my addr 172.21.15.135:0/384910555 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbe59c640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc009ce60 0x7f3fc0134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbed9d640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 0x7f3fc01d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 -- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc009ce60 msgr2=0x7f3fc0134530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc009ce60 0x7f3fc0134530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 -- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 msgr2=0x7f3fc01d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 0x7f3fc01d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 -- 172.21.15.135:0/384910555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc00a5670 con 0x7f3fc0139780 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbed9d640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 0x7f3fc01d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fbdd9b640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ebe0 tx=0x7f3fb400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:06.883 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4017070 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb400cc30 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc00a69d0 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4013470 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc0134fb0 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fb401a070 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.880+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3fb4006020 con 0x7f3fc0139780 2024-05-09T12:20:06.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.881+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc0076500 con 0x7f3fc0139780 2024-05-09T12:20:06.885 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.883+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3fb40139d0 con 0x7f3fc0139780 2024-05-09T12:20:06.908 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:06.908+0000 7f560c00e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T12:20:06.942 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.943+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fc009cc40 con 0x7f3fc0139780 2024-05-09T12:20:06.942 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.943+0000 7f3faeffd640 1 -- 172.21.15.135:0/384910555 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f3fb4013bb0 con 0x7f3fc0139780 2024-05-09T12:20:06.943 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-09T12:20:06.943 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":6,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:06.169041+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 msgr2=0x7f3fc0134a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ebe0 tx=0x7f3fb400c520 comp rx=0 tx=0).stop 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 shutdown_connections 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fc013cce0 0x7f3fc01d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3fc0139780 0x7f3fc0134a70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 --2- 172.21.15.135:0/384910555 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3fc009ce60 0x7f3fc0134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 >> 172.21.15.135:0/384910555 conn(0x7f3fc0075cd0 msgr2=0x7f3fc0137410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 shutdown_connections 2024-05-09T12:20:06.944 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:06.944+0000 7f3fc4ee6640 1 -- 172.21.15.135:0/384910555 wait complete. 2024-05-09T12:20:06.953 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-09T12:20:06.984 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:06.985+0000 7f247d893040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T12:20:07.018 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.019+0000 7f560c00e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T12:20:07.365 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:07.366+0000 7f247d893040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T12:20:07.416 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.416+0000 7f560c00e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T12:20:07.503 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:07.503+0000 7f247d893040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T12:20:07.554 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.555+0000 7f560c00e040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T12:20:07.759 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:07.760+0000 7f247d893040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T12:20:07.810 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:07.811+0000 7f247d893040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T12:20:07.813 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.814+0000 7f560c00e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T12:20:07.867 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.868+0000 7f560c00e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T12:20:07.927 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:07.928+0000 7f247d893040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T12:20:07.985 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:07.985+0000 7f560c00e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T12:20:08.268 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.269+0000 7f560c00e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T12:20:08.275 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.276+0000 7f247d893040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T12:20:08.316 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.317+0000 7f560c00e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T12:20:08.322 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.323+0000 7f247d893040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T12:20:08.474 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.474+0000 7f560c00e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T12:20:08.478 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.479+0000 7f247d893040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T12:20:08.610 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.610+0000 7f560c00e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T12:20:08.612 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.613+0000 7f247d893040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T12:20:08.660 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.660+0000 7f560c00e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T12:20:08.661 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.662+0000 7f247d893040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T12:20:08.731 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.732+0000 7f247d893040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T12:20:08.732 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.733+0000 7f560c00e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T12:20:08.777 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:08.778+0000 7f247d893040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T12:20:08.778 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:08.778+0000 7f560c00e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T12:20:09.246 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:09.247+0000 7f247d893040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T12:20:09.257 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:09.257+0000 7f560c00e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T12:20:09.364 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:09.365+0000 7f247d893040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T12:20:09.374 INFO:tasks.ceph.mgr.y.smithi160.stderr:2024-05-09T12:20:09.375+0000 7f560c00e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T12:20:10.238 INFO:tasks.ceph.osd.2.smithi160.stderr:2024-05-09T12:20:10.239+0000 7fedb01a3640 -1 osd.2 0 log_to_monitors true 2024-05-09T12:20:10.293 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-05-09T12:20:10.293+0000 7f49f8cae640 -1 osd.3 0 log_to_monitors true 2024-05-09T12:20:10.353 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-09T12:20:10.354+0000 7fe887eac640 -1 osd.0 0 log_to_monitors true 2024-05-09T12:20:10.377 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:10.378+0000 7f241dc53640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T12:20:10.379 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-05-09T12:20:10.380+0000 7f241dc53640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T12:20:10.380 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-09T12:20:10.381+0000 7f1cb0e0f640 -1 osd.1 0 log_to_monitors true 2024-05-09T12:20:12.551 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-05-09T12:20:12.551+0000 7f49f4c44640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T12:20:12.564 INFO:tasks.ceph.osd.2.smithi160.stderr:2024-05-09T12:20:12.564+0000 7fedac139640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T12:20:12.569 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-05-09T12:20:12.570+0000 7f49eca64640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T12:20:12.576 INFO:tasks.ceph.osd.2.smithi160.stderr:2024-05-09T12:20:12.577+0000 7feda3f59640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T12:20:12.621 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-09T12:20:12.622+0000 7fe884656640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T12:20:12.627 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-09T12:20:12.628+0000 7f1cac7ff640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T12:20:12.636 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-09T12:20:12.637+0000 7fe87bc62640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T12:20:12.641 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-09T12:20:12.642+0000 7f1ca461f640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T12:20:13.356 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:13.452 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.451+0000 7f56824d2640 1 Processor -- start 2024-05-09T12:20:13.452 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.451+0000 7f56824d2640 1 -- start start 2024-05-09T12:20:13.452 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 0x7f567c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.452 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0a8610 0x7f567c0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f567c0a9ce0 0x7f567c0aa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f567c0ab540 con 0x7f567c0a9ce0 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f567c0a8ac0 con 0x7f567c139a10 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f56824d2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f567c0aaa40 con 0x7f567c0a8610 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f567c0a9ce0 0x7f567c0aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f567c0a9ce0 0x7f567c0aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44480/0 (socket says 172.21.15.135:44480) 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 -- 172.21.15.135:0/2198392200 learned_addr learned my addr 172.21.15.135:0/2198392200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f567bfff640 1 --2- 172.21.15.135:0/2198392200 >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 0x7f567c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5673fff640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0a8610 0x7f567c0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 -- 172.21.15.135:0/2198392200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0a8610 msgr2=0x7f567c0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0a8610 0x7f567c0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 -- 172.21.15.135:0/2198392200 >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 msgr2=0x7f567c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 --2- 172.21.15.135:0/2198392200 >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 0x7f567c139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.453 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f5680a6f640 1 -- 172.21.15.135:0/2198392200 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c13a330 con 0x7f567c0a9ce0 2024-05-09T12:20:13.454 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.452+0000 7f567bfff640 1 --2- 172.21.15.135:0/2198392200 >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 0x7f567c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:13.454 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.453+0000 7f5680a6f640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a9ce0 0x7f567c0aa190 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ab050 tx=0x7f567402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823fa22eb664fe16 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.454 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.453+0000 7f567b7fe640 1 -- 172.21.15.135:0/2198392200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567402c9e0 con 0x7f567c0a9ce0 2024-05-09T12:20:13.454 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.453+0000 7f567b7fe640 1 -- 172.21.15.135:0/2198392200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567402cb80 con 0x7f567c0a9ce0 2024-05-09T12:20:13.454 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.453+0000 7f567b7fe640 1 -- 172.21.15.135:0/2198392200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56740343f0 con 0x7f567c0a9ce0 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 -- 172.21.15.135:0/2198392200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a9ce0 msgr2=0x7f567c0aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a9ce0 0x7f567c0aa190 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ab050 tx=0x7f567402be40 comp rx=0 tx=0).stop 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 -- 172.21.15.135:0/2198392200 shutdown_connections 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c0a8610 0x7f567c0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 --2- 172.21.15.135:0/2198392200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a9ce0 0x7f567c0aa190 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 --2- 172.21.15.135:0/2198392200 >> v2:172.21.15.160:3300/0 conn(0x7f567c139a10 0x7f567c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.457 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 -- 172.21.15.135:0/2198392200 >> 172.21.15.135:0/2198392200 conn(0x7f567c0756c0 msgr2=0x7f567c075ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 -- 172.21.15.135:0/2198392200 shutdown_connections 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 -- 172.21.15.135:0/2198392200 wait complete. 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.454+0000 7f56824d2640 1 Processor -- start 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 -- start start 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0a9ce0 0x7f567c136e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c139a10 0x7f567c1d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0a7630 con 0x7f567c0a8610 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f567c0abe00 con 0x7f567c0a9ce0 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f56824d2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f567c0a80a0 con 0x7f567c139a10 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44494/0 (socket says 172.21.15.135:44494) 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 -- 172.21.15.135:0/523622227 learned_addr learned my addr 172.21.15.135:0/523622227 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:13.458 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f5673fff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0a9ce0 0x7f567c136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f5680a6f640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c139a10 0x7f567c1d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 -- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c139a10 msgr2=0x7f567c1d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c139a10 0x7f567c1d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 -- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0a9ce0 msgr2=0x7f567c136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0a9ce0 0x7f567c136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 -- 172.21.15.135:0/523622227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c1373b0 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.455+0000 7f567bfff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f566c00e760 tx=0x7f566c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.456+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c00f040 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.456+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c004230 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.456+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c00ee70 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.456+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c0a5ac0 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.456+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c0a2e70 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.457+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c076500 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.457+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f566c00c6d0 con 0x7f567c0a8610 2024-05-09T12:20:13.459 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.458+0000 7f56797fa640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 0x7f565c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.460 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.458+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7f566c096020 con 0x7f567c0a8610 2024-05-09T12:20:13.460 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.458+0000 7f5673fff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 0x7f565c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.460 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.458+0000 7f5673fff640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 0x7f565c078700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f567c0a2870 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.461 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.462+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f566c017020 con 0x7f567c0a8610 2024-05-09T12:20:13.648 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.649+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f567c0a1b80 con 0x7f567c0a8610 2024-05-09T12:20:13.648 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.649+0000 7f56797fa640 1 -- 172.21.15.135:0/523622227 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6104 (secure 0 0 0) 0x7f566c060490 con 0x7f567c0a8610 2024-05-09T12:20:13.649 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-09T12:20:13.649 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":9,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:13.567845+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:13.650 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 msgr2=0x7f565c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 0x7f565c078700 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f567c0a2870 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 msgr2=0x7f567c136930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f566c00e760 tx=0x7f566c00ec20 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 shutdown_connections 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f565c076240 0x7f565c078700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f567c139a10 0x7f567c1d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f567c0a9ce0 0x7f567c136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 --2- 172.21.15.135:0/523622227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f567c0a8610 0x7f567c136930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 >> 172.21.15.135:0/523622227 conn(0x7f567c0756c0 msgr2=0x7f567c1384a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 shutdown_connections 2024-05-09T12:20:13.651 INFO:teuthology.misc.health.smithi135.stderr:2024-05-09T12:20:13.651+0000 7f56824d2640 1 -- 172.21.15.135:0/523622227 wait complete. 2024-05-09T12:20:13.660 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-09T12:20:13.660 INFO:tasks.ceph:Creating RBD pool 2024-05-09T12:20:13.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.761+0000 7f3a01ec3640 1 Processor -- start 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.761+0000 7f3a01ec3640 1 -- start start 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.761+0000 7f3a01ec3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f3a01ec3640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f39fc13d370 0x7f39fc144a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f3a01ec3640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc09bfe0 con 0x7f39fc139880 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f3a01ec3640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc09b3d0 con 0x7f39fc13d370 2024-05-09T12:20:13.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f3a01ec3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0a0e30 con 0x7f39fc139c60 2024-05-09T12:20:13.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39faffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39fbfff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f39fc13d370 0x7f39fc144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39fb7fe640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f39fc139880 0x7f39fc13c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:48768/0 (socket says 172.21.15.135:48768) 2024-05-09T12:20:13.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39fb7fe640 1 -- 172.21.15.135:0/4102350069 learned_addr learned my addr 172.21.15.135:0/4102350069 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:13.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39faffd640 1 -- 172.21.15.135:0/4102350069 >> v2:172.21.15.160:3300/0 conn(0x7f39fc13d370 msgr2=0x7f39fc144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:13.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39faffd640 1 --2- 172.21.15.135:0/4102350069 >> v2:172.21.15.160:3300/0 conn(0x7f39fc13d370 0x7f39fc144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39faffd640 1 -- 172.21.15.135:0/4102350069 >> v1:172.21.15.160:6789/0 conn(0x7f39fc139880 legacy=0x7f39fc13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.762+0000 7f39faffd640 1 -- 172.21.15.135:0/4102350069 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc09b710 con 0x7f39fc139c60 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.763+0000 7f39faffd640 1 --2- 172.21.15.135:0/4102350069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc13ce30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097a0 tx=0x7f39f002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682b29c732dc9b9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.763+0000 7f39fa7fc640 1 -- 172.21.15.135:0/4102350069 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0038070 con 0x7f39fc139c60 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.763+0000 7f39fa7fc640 1 -- 172.21.15.135:0/4102350069 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0031700 con 0x7f39fc139c60 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.763+0000 7f39fa7fc640 1 -- 172.21.15.135:0/4102350069 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0031ad0 con 0x7f39fc139c60 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 -- 172.21.15.135:0/4102350069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 msgr2=0x7f39fc13ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/4102350069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc13ce30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097a0 tx=0x7f39f002b7a0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 -- 172.21.15.135:0/4102350069 shutdown_connections 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/4102350069 >> v2:172.21.15.160:3300/0 conn(0x7f39fc13d370 0x7f39fc144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/4102350069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc13ce30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 -- 172.21.15.135:0/4102350069 >> 172.21.15.135:0/4102350069 conn(0x7f39fc0aeba0 msgr2=0x7f39fc0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 -- 172.21.15.135:0/4102350069 shutdown_connections 2024-05-09T12:20:13.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.764+0000 7f3a01ec3640 1 -- 172.21.15.135:0/4102350069 wait complete. 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 Processor -- start 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 -- start start 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39fc139880 0x7f39fc1d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc1d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc09c2c0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc09b9a0 con 0x7f39fc139880 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.765+0000 7f3a01ec3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc09cf10 con 0x7f39fc139c60 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44508/0 (socket says 172.21.15.135:44508) 2024-05-09T12:20:13.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 -- 172.21.15.135:0/712756806 learned_addr learned my addr 172.21.15.135:0/712756806 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fb7fe640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39fc139880 0x7f39fc1d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39faffd640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc1d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 -- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 msgr2=0x7f39fc1d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc1d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 -- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39fc139880 msgr2=0x7f39fc1d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39fc139880 0x7f39fc1d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 -- 172.21.15.135:0/712756806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc0a8020 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39fbfff640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e860 tx=0x7f39f400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4017070 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f400c6d0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc0a8dc0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f400cac0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.766+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc0a93a0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.767+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc06e8d0 con 0x7f39fc1d29f0 2024-05-09T12:20:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.768+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f39f401a070 con 0x7f39fc1d29f0 2024-05-09T12:20:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.768+0000 7f39e3fff640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 0x7f39e8078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.768+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f39f4096800 con 0x7f39fc1d29f0 2024-05-09T12:20:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.768+0000 7f39fb7fe640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 0x7f39e8078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.769+0000 7f39fb7fe640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 0x7f39e8078730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0012e0 tx=0x7f39ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:13.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.773+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39f4060810 con 0x7f39fc1d29f0 2024-05-09T12:20:13.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:13.954+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f39fc0508d0 con 0x7f39fc1d29f0 2024-05-09T12:20:14.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.575+0000 7f39e3fff640 1 -- 172.21.15.135:0/712756806 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7f39f4064b10 con 0x7f39fc1d29f0 2024-05-09T12:20:14.574 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'rbd' created 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.577+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 msgr2=0x7f39e8078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.577+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 0x7f39e8078730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0012e0 tx=0x7f39ec009040 comp rx=0 tx=0).stop 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.577+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 msgr2=0x7f39fc136300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.577+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e860 tx=0x7f39f400ed20 comp rx=0 tx=0).stop 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 shutdown_connections 2024-05-09T12:20:14.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f39e8076270 0x7f39e8078730 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39fc1d29f0 0x7f39fc136300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc139c60 0x7f39fc1d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 --2- 172.21.15.135:0/712756806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39fc139880 0x7f39fc1d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 >> 172.21.15.135:0/712756806 conn(0x7f39fc0aeba0 msgr2=0x7f39fc13c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 shutdown_connections 2024-05-09T12:20:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.578+0000 7f3a01ec3640 1 -- 172.21.15.135:0/712756806 wait complete. 2024-05-09T12:20:14.590 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-09T12:20:14.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.694+0000 7f01bc9f6640 1 Processor -- start 2024-05-09T12:20:14.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.694+0000 7f01bc9f6640 1 -- start start 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01bc9f6640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01bc9f6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01bc9f6640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b809d990 con 0x7f01b813d150 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01bc9f6640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f01b81392f0 con 0x7f01b8139a60 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01bc9f6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f01b80a0560 con 0x7f01b813c7f0 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b5d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b5d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:59800/0 (socket says 172.21.15.135:59800) 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:42518/0 (socket says 172.21.15.135:42518) 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b5d9b640 1 -- 172.21.15.135:0/1321952844 learned_addr learned my addr 172.21.15.135:0/1321952844 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.695+0000 7f01b6d9d640 1 --1- 172.21.15.135:0/1321952844 >> v1:172.21.15.160:6789/0 conn(0x7f01b813d150 0x7f01b8143b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:48780/0 (socket says 172.21.15.135:48780) 2024-05-09T12:20:14.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b5d9b640 1 -- 172.21.15.135:0/1321952844 >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 msgr2=0x7f01b8139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b5d9b640 1 --2- 172.21.15.135:0/1321952844 >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b5d9b640 1 -- 172.21.15.135:0/1321952844 >> v1:172.21.15.160:6789/0 conn(0x7f01b813d150 legacy=0x7f01b8143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b5d9b640 1 -- 172.21.15.135:0/1321952844 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b809f610 con 0x7f01b813c7f0 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b659c640 1 --2- 172.21.15.135:0/1321952844 >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.696+0000 7f01b5d9b640 1 --2- 172.21.15.135:0/1321952844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009870 tx=0x7f01ac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aba2dd47f466096 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01b559a640 1 -- 172.21.15.135:0/1321952844 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac034070 con 0x7f01b813c7f0 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01b559a640 1 -- 172.21.15.135:0/1321952844 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac030840 con 0x7f01b813c7f0 2024-05-09T12:20:14.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01b559a640 1 -- 172.21.15.135:0/1321952844 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac030c10 con 0x7f01b813c7f0 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 -- 172.21.15.135:0/1321952844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 msgr2=0x7f01b813cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/1321952844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009870 tx=0x7f01ac02b980 comp rx=0 tx=0).stop 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 -- 172.21.15.135:0/1321952844 shutdown_connections 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/1321952844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813c7f0 0x7f01b813cc10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/1321952844 >> v2:172.21.15.160:3300/0 conn(0x7f01b8139a60 0x7f01b8139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 -- 172.21.15.135:0/1321952844 >> 172.21.15.135:0/1321952844 conn(0x7f01b80abcd0 msgr2=0x7f01b80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:14.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 -- 172.21.15.135:0/1321952844 shutdown_connections 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.697+0000 7f01bc9f6640 1 -- 172.21.15.135:0/1321952844 wait complete. 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.698+0000 7f01bc9f6640 1 Processor -- start 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.698+0000 7f01bc9f6640 1 -- start start 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01b813c7f0 0x7f01b81ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 0x7f01b81d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01b809d620 con 0x7f01b8139a60 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f01b813d580 con 0x7f01b813c7f0 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01bc9f6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f01b80a00e0 con 0x7f01b813d150 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44520/0 (socket says 172.21.15.135:44520) 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 -- 172.21.15.135:0/2900057549 learned_addr learned my addr 172.21.15.135:0/2900057549 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b6d9d640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 0x7f01b81d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b5d9b640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01b813c7f0 0x7f01b81ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 -- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 msgr2=0x7f01b81d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 0x7f01b81d1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 -- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01b813c7f0 msgr2=0x7f01b81ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01b813c7f0 0x7f01b81ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 -- 172.21.15.135:0/2900057549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b81224b0 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b6d9d640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 0x7f01b81d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.699+0000 7f01b659c640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01a800efc0 tx=0x7f01a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.700+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8018020 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.700+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8014680 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.700+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b8123eb0 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.700+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8014a50 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.700+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b81242c0 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.701+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b8069a50 con 0x7f01b8139a60 2024-05-09T12:20:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.701+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f01a8005d10 con 0x7f01b8139a60 2024-05-09T12:20:14.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.702+0000 7f01a6ffd640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 0x7f0198078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:14.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.702+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3085+0+0 (secure 0 0 0) 0x7f01a80976e0 con 0x7f01b8139a60 2024-05-09T12:20:14.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.702+0000 7f01b5d9b640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 0x7f0198078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:14.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.702+0000 7f01b5d9b640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 0x7f0198078700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01ac036000 tx=0x7f01ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:14.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.706+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f01a8022030 con 0x7f01b8139a60 2024-05-09T12:20:14.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:14.890+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f01b809d180 con 0x7f01b8139a60 2024-05-09T12:20:15.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:20:15.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:20:15.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:20:15.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.580+0000 7f01a6ffd640 1 -- 172.21.15.135:0/2900057549 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7f01a8010040 con 0x7f01b8139a60 2024-05-09T12:20:15.579 INFO:teuthology.orchestra.run.smithi135.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.583+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 msgr2=0x7f0198078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.583+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 0x7f0198078700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01ac036000 tx=0x7f01ac008030 comp rx=0 tx=0).stop 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.583+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 msgr2=0x7f01b8124ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.583+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01a800efc0 tx=0x7f01a800c490 comp rx=0 tx=0).stop 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 shutdown_connections 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0198076240 0x7f0198078700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01b813d150 0x7f01b81d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01b813c7f0 0x7f01b81ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 --2- 172.21.15.135:0/2900057549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01b8139a60 0x7f01b8124ca0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f01a800efc0 tx=0x7f01a800c490 comp rx=0 tx=0).stop 2024-05-09T12:20:15.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 >> 172.21.15.135:0/2900057549 conn(0x7f01b80abcd0 msgr2=0x7f01b80a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:15.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 shutdown_connections 2024-05-09T12:20:15.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.584+0000 7f01bc9f6640 1 -- 172.21.15.135:0/2900057549 wait complete. 2024-05-09T12:20:15.595 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T12:20:15.595 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T12:20:15.596 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T12:20:15.598 INFO:tasks.ceph.mds.a:Started 2024-05-09T12:20:15.599 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T12:20:15.599 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T12:20:15.602 INFO:tasks.ceph.mds.b:Started 2024-05-09T12:20:15.602 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T12:20:15.603 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:15.674 INFO:tasks.ceph.mds.a.smithi135.stdout:starting mds.a at 2024-05-09T12:20:15.682 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-05-09T12:20:15.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.707+0000 7fd80b996640 1 Processor -- start 2024-05-09T12:20:15.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.707+0000 7fd80b996640 1 -- start start 2024-05-09T12:20:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd804139890 0x7fd804139c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 0x7fd80413c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd80413cd30 0x7fd80413d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd804139390 con 0x7fd80413cd30 2024-05-09T12:20:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fd80409f540 con 0x7fd804139890 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd80b996640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd80406cd20 con 0x7fd80409d0a0 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd80413cd30 0x7fd80413d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd80413cd30 0x7fd80413d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44542/0 (socket says 172.21.15.135:44542) 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 -- 172.21.15.135:0/1152969743 learned_addr learned my addr 172.21.15.135:0/1152969743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809732640 1 --2- 172.21.15.135:0/1152969743 >> v2:172.21.15.160:3300/0 conn(0x7fd804139890 0x7fd804139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd808f31640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 0x7fd80413c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 -- 172.21.15.135:0/1152969743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 msgr2=0x7fd80413c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 0x7fd80413c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 -- 172.21.15.135:0/1152969743 >> v2:172.21.15.160:3300/0 conn(0x7fd804139890 msgr2=0x7fd804139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 --2- 172.21.15.135:0/1152969743 >> v2:172.21.15.160:3300/0 conn(0x7fd804139890 0x7fd804139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd809f33640 1 -- 172.21.15.135:0/1152969743 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80413a1b0 con 0x7fd80413cd30 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.708+0000 7fd808f31640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 0x7fd80413c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:15.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.709+0000 7fd809f33640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80413cd30 0x7fd80413d180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd80406c730 tx=0x7fd7fc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8776918dd4c3d1e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.709+0000 7fd7fbfff640 1 -- 172.21.15.135:0/1152969743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02c950 con 0x7fd80413cd30 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.709+0000 7fd7fbfff640 1 -- 172.21.15.135:0/1152969743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc02caf0 con 0x7fd80413cd30 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.709+0000 7fd7fbfff640 1 -- 172.21.15.135:0/1152969743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0343f0 con 0x7fd80413cd30 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 -- 172.21.15.135:0/1152969743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80413cd30 msgr2=0x7fd80413d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80413cd30 0x7fd80413d180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd80406c730 tx=0x7fd7fc02bdb0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 -- 172.21.15.135:0/1152969743 shutdown_connections 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80409d0a0 0x7fd80413c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 --2- 172.21.15.135:0/1152969743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd80413cd30 0x7fd80413d180 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 --2- 172.21.15.135:0/1152969743 >> v2:172.21.15.160:3300/0 conn(0x7fd804139890 0x7fd804139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 -- 172.21.15.135:0/1152969743 >> 172.21.15.135:0/1152969743 conn(0x7fd8040aba90 msgr2=0x7fd8040abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 -- 172.21.15.135:0/1152969743 shutdown_connections 2024-05-09T12:20:15.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.710+0000 7fd80b996640 1 -- 172.21.15.135:0/1152969743 wait complete. 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 Processor -- start 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 -- start start 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80413cd30 0x7fd804136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8041d1cb0 0x7fd8041d2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd80409e100 con 0x7fd804139890 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd80409de00 con 0x7fd8041d1cb0 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd80b996640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd80409d680 con 0x7fd80413cd30 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd809732640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd809732640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44546/0 (socket says 172.21.15.135:44546) 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd809732640 1 -- 172.21.15.135:0/4024005733 learned_addr learned my addr 172.21.15.135:0/4024005733 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd809f33640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8041d1cb0 0x7fd8041d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.711+0000 7fd808f31640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80413cd30 0x7fd804136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 -- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80413cd30 msgr2=0x7fd804136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80413cd30 0x7fd804136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 -- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8041d1cb0 msgr2=0x7fd8041d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8041d1cb0 0x7fd8041d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 -- 172.21.15.135:0/4024005733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8040a4170 con 0x7fd804139890 2024-05-09T12:20:15.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd809732640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400e9e0 tx=0x7fd7f400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4017070 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f400c9d0 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8040a3860 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400cdc0 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.712+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8040a4770 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.713+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8040508d0 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.714+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fd7f401a070 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.714+0000 7fd7f9ffb640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 0x7fd7e8078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.714+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3471+0+0 (secure 0 0 0) 0x7fd7f4096e10 con 0x7fd804139890 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.714+0000 7fd808f31640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 0x7fd7e8078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:15.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.715+0000 7fd808f31640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 0x7fd7e8078730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8040a05e0 tx=0x7fd800008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:15.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.719+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7f4060b50 con 0x7fd804139890 2024-05-09T12:20:15.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.936+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8040a5960 con 0x7fd804139890 2024-05-09T12:20:15.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.937+0000 7fd7f9ffb640 1 -- 172.21.15.135:0/4024005733 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fd7f4064e50 con 0x7fd804139890 2024-05-09T12:20:15.937 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:15.937 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T12:20:15.937 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-05-09T12:20:15.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 msgr2=0x7fd7e8078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 0x7fd7e8078730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8040a05e0 tx=0x7fd800008040 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 msgr2=0x7fd804136590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400e9e0 tx=0x7fd7f400eea0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 shutdown_connections 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd7e8076270 0x7fd7e8078730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8041d1cb0 0x7fd8041d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80413cd30 0x7fd804136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 --2- 172.21.15.135:0/4024005733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd804139890 0x7fd804136590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 >> 172.21.15.135:0/4024005733 conn(0x7fd8040aba90 msgr2=0x7fd8040a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 shutdown_connections 2024-05-09T12:20:15.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:15.939+0000 7fd80b996640 1 -- 172.21.15.135:0/4024005733 wait complete. 2024-05-09T12:20:17.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:18.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 Processor -- start 2024-05-09T12:20:18.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 -- start start 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6434073600 0x7f64340739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64340715b0 con 0x7f6434073f20 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6434070a20 con 0x7f6434139b00 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f643b827640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f6434071860 con 0x7f6434073600 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f6438dc2640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6434073f20 0x7f64341393f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54230/0 (socket says 172.21.15.135:54230) 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f6438dc2640 1 -- 172.21.15.135:0/469233207 learned_addr learned my addr 172.21.15.135:0/469233207 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f64395c3640 1 --2- 172.21.15.135:0/469233207 >> v2:172.21.15.160:3300/0 conn(0x7f6434073600 0x7f64340739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238961729 0 0) 0x7f64340715b0 con 0x7f6434073f20 2024-05-09T12:20:18.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.055+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f641c003520 con 0x7f6434073f20 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3891334759 0 0) 0x7f641c003520 con 0x7f6434073f20 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 >> v2:172.21.15.160:3300/0 conn(0x7f6434073600 msgr2=0x7f64340739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 --2- 172.21.15.135:0/469233207 >> v2:172.21.15.160:3300/0 conn(0x7f6434073600 0x7f64340739e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 >> v1:172.21.15.160:6789/0 conn(0x7f6434139b00 legacy=0x7f6434141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6434071e00 con 0x7f6434073f20 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f64280016f0 con 0x7f6434073f20 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 >> v1:172.21.15.135:6789/0 conn(0x7f6434073f20 legacy=0x7f64341393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f641c003a50 0x7f641c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f641c004800 0x7f641c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f641c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6434071860 con 0x7f641c0053c0 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f641c00c230 con 0x7f641c004800 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f641c00c430 con 0x7f641c003a50 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f641c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6438dc2640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f641c004800 0x7f641c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f64395c3640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f641c003a50 0x7f641c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 -- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f641c003a50 msgr2=0x7f641c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f641c003a50 0x7f641c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 -- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f641c004800 msgr2=0x7f641c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f641c004800 0x7f641c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f6439dc4640 1 -- 172.21.15.135:0/469233207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c003520 con 0x7f641c0053c0 2024-05-09T12:20:18.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.057+0000 7f64395c3640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f641c003a50 0x7f641c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f6439dc4640 1 -- 172.21.15.135:0/469233207 reap_dead start 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f6439dc4640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f641c00b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f642c001e90 tx=0x7f641c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dde09c1612d88c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c001ab0 con 0x7f641c0053c0 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c003b70 con 0x7f641c0053c0 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f6433fff640 1 -- 172.21.15.135:0/469233207 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0050d0 con 0x7f641c0053c0 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 msgr2=0x7f641c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f641c00b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f642c001e90 tx=0x7f641c005830 comp rx=0 tx=0).stop 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- 172.21.15.135:0/469233207 shutdown_connections 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 --2- 172.21.15.135:0/469233207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f641c00b9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- 172.21.15.135:0/469233207 >> 172.21.15.135:0/469233207 conn(0x7f64340ab940 msgr2=0x7f64340abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- 172.21.15.135:0/469233207 shutdown_connections 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- 172.21.15.135:0/469233207 wait complete. 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 Processor -- start 2024-05-09T12:20:18.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.058+0000 7f643b827640 1 -- start start 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6434138890 0x7f64341d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 0x7f64341d2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6434070e50 con 0x7f641c0053c0 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64340729e0 con 0x7f6434138890 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f643b827640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6434072590 con 0x7f64341d23f0 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44590/0 (socket says 172.21.15.135:44590) 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 -- 172.21.15.135:0/2155623683 learned_addr learned my addr 172.21.15.135:0/2155623683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f6438dc2640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6434138890 0x7f64341d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f6439dc4640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 0x7f64341d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 -- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 msgr2=0x7f64341d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 0x7f64341d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 -- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6434138890 msgr2=0x7f64341d1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6434138890 0x7f64341d1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 -- 172.21.15.135:0/2155623683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6434123ae0 con 0x7f641c0053c0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f6439dc4640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 0x7f64341d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.059+0000 7f64395c3640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6424011540 tx=0x7f6424011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.061+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424015870 con 0x7f641c0053c0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.061+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6424015a10 con 0x7f641c0053c0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.061+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6434122420 con 0x7f641c0053c0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.061+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424015dc0 con 0x7f641c0053c0 2024-05-09T12:20:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.061+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64340a7d40 con 0x7f641c0053c0 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.062+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64340508d0 con 0x7f641c0053c0 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.063+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f642401d400 con 0x7f641c0053c0 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.063+0000 7f6431ffb640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 0x7f6420078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.063+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3482+0+0 (secure 0 0 0) 0x7f64240975a0 con 0x7f641c0053c0 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.063+0000 7f6438dc2640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 0x7f6420078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.064+0000 7f6438dc2640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 0x7f6420078790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f64340a7540 tx=0x7f6428007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.068+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6434123ae0 con 0x7f641c0053c0 2024-05-09T12:20:18.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.282+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643409df20 con 0x7f641c0053c0 2024-05-09T12:20:18.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.282+0000 7f6431ffb640 1 -- 172.21.15.135:0/2155623683 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2222 (secure 0 0 0) 0x7f6424019030 con 0x7f641c0053c0 2024-05-09T12:20:18.280 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:18.281 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T12:20:18.281 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 3 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 msgr2=0x7f6420078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 0x7f6420078790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f64340a7540 tx=0x7f6428007970 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 msgr2=0x7f6434138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6424011540 tx=0x7f6424011940 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 shutdown_connections 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f64200762d0 0x7f6420078790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64341d23f0 0x7f64341d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6434138890 0x7f64341d1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 --2- 172.21.15.135:0/2155623683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641c0053c0 0x7f6434138350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 >> 172.21.15.135:0/2155623683 conn(0x7f64340ab940 msgr2=0x7f64341c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 shutdown_connections 2024-05-09T12:20:18.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.284+0000 7f643b827640 1 -- 172.21.15.135:0/2155623683 wait complete. 2024-05-09T12:20:18.293 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T12:20:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 Processor -- start 2024-05-09T12:20:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 -- start start 2024-05-09T12:20:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f34e413d720 0x7f34e413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4140050 0x7f34e4142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e409bc20 con 0x7f34e4137680 2024-05-09T12:20:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f34e409c700 con 0x7f34e413d720 2024-05-09T12:20:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.395+0000 7f34ea596640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f34e4074560 con 0x7f34e4140050 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f34e413d720 0x7f34e413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e8b33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4140050 0x7f34e4142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f34e413d720 0x7f34e413fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:42642/0 (socket says 172.21.15.135:42642) 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 -- 172.21.15.135:0/1557895704 learned_addr learned my addr 172.21.15.135:0/1557895704 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 -- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4140050 msgr2=0x7f34e4142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 --2- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4140050 0x7f34e4142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 -- 172.21.15.135:0/1557895704 >> v1:172.21.15.160:6789/0 conn(0x7f34e4137680 legacy=0x7f34e4137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e37fe640 1 -- 172.21.15.135:0/1557895704 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e409b230 con 0x7f34e413d720 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.396+0000 7f34e2ffd640 1 -- 172.21.15.135:0/1557895704 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244154045 0 0) 0x7f34d4001110 con 0x7f34e4137680 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34e37fe640 1 --2- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e413fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009870 tx=0x7f34d802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=801ba83eaf18ec84 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34e2ffd640 1 -- 172.21.15.135:0/1557895704 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80317c0 con 0x7f34e413d720 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34e2ffd640 1 -- 172.21.15.135:0/1557895704 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d8037070 con 0x7f34e413d720 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34e2ffd640 1 -- 172.21.15.135:0/1557895704 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8031b80 con 0x7f34e413d720 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 -- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 msgr2=0x7f34e413fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 --2- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e413fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009870 tx=0x7f34d802b860 comp rx=0 tx=0).stop 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 -- 172.21.15.135:0/1557895704 shutdown_connections 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 --2- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4140050 0x7f34e4142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 --2- 172.21.15.135:0/1557895704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e413fb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.397+0000 7f34ea596640 1 -- 172.21.15.135:0/1557895704 >> 172.21.15.135:0/1557895704 conn(0x7f34e40aca30 msgr2=0x7f34e40ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.398+0000 7f34ea596640 1 -- 172.21.15.135:0/1557895704 shutdown_connections 2024-05-09T12:20:18.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.398+0000 7f34ea596640 1 -- 172.21.15.135:0/1557895704 wait complete. 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.398+0000 7f34ea596640 1 Processor -- start 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 -- start start 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4137680 0x7f34e41cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e41d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f34e409d270 con 0x7f34e4140050 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f34e409e880 con 0x7f34e413d720 2024-05-09T12:20:18.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34ea596640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f34e409b660 con 0x7f34e4137680 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44598/0 (socket says 172.21.15.135:44598) 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 -- 172.21.15.135:0/167376735 learned_addr learned my addr 172.21.15.135:0/167376735 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e37fe640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e41d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e3fff640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4137680 0x7f34e41cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 -- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4137680 msgr2=0x7f34e41cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4137680 0x7f34e41cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.399+0000 7f34e8b33640 1 -- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 msgr2=0x7f34e41d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e8b33640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e41d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e8b33640 1 -- 172.21.15.135:0/167376735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e413ae60 con 0x7f34e4140050 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e8b33640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00efc0 tx=0x7f34dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc018020 con 0x7f34e4140050 2024-05-09T12:20:18.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc014480 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e413d1e0 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc009e60 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.400+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e413b2e0 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.401+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e40508d0 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.401+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34dc005d10 con 0x7f34e4140050 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.402+0000 7f34e0ff9640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 0x7f34d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.402+0000 7f34e3fff640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 0x7f34d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.402+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3482+0+0 (secure 0 0 0) 0x7f34dc0979d0 con 0x7f34e4140050 2024-05-09T12:20:18.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.402+0000 7f34e3fff640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 0x7f34d0078790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f60 tx=0x7f34d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.406+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f34dc022030 con 0x7f34e4140050 2024-05-09T12:20:18.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.587+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f34e413c0f0 con 0x7f34e4140050 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.588+0000 7f34e0ff9640 1 -- 172.21.15.135:0/167376735 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) ==== 84+0+126 (secure 0 0 0) 0x7f34dc010040 con 0x7f34e4140050 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-05-09T12:20:18.586 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": "rbd" 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 2, 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-09T12:20:18.587 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-09T12:20:18.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.589+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 msgr2=0x7f34d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.589+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 0x7f34d0078790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34d4000f60 tx=0x7f34d4009040 comp rx=0 tx=0).stop 2024-05-09T12:20:18.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 msgr2=0x7f34e41d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00efc0 tx=0x7f34dc00c490 comp rx=0 tx=0).stop 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 shutdown_connections 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f34d00762d0 0x7f34d0078790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e4140050 0x7f34e41d0590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34e413d720 0x7f34e41d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 --2- 172.21.15.135:0/167376735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34e4137680 0x7f34e41cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 >> 172.21.15.135:0/167376735 conn(0x7f34e40aca30 msgr2=0x7f34e41346f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 shutdown_connections 2024-05-09T12:20:18.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.590+0000 7f34ea596640 1 -- 172.21.15.135:0/167376735 wait complete. 2024-05-09T12:20:18.599 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T12:20:18.599 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.703+0000 7f04f3e95640 1 Processor -- start 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.703+0000 7f04f3e95640 1 -- start start 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f3e95640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 0x7f04ec13f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f3e95640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 0x7f04ec1420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f3e95640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04ec137e90 con 0x7f04ec1373a0 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f3e95640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f04ec072530 con 0x7f04ec071fb0 2024-05-09T12:20:18.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f3e95640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec072990 con 0x7f04ec13fcd0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f1c31640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f04ec1373a0 0x7f04ec137780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54232/0 (socket says 172.21.15.135:54232) 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f1c31640 1 -- 172.21.15.135:0/2776108608 learned_addr learned my addr 172.21.15.135:0/2776108608 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f1430640 1 --2- 172.21.15.135:0/2776108608 >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 0x7f04ec13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f2432640 1 --2- 172.21.15.135:0/2776108608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 0x7f04ec1420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693886840 0 0) 0x7f04ec137e90 con 0x7f04ec1373a0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d4003520 con 0x7f04ec1373a0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f2432640 1 -- 172.21.15.135:0/2776108608 >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 msgr2=0x7f04ec13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f2432640 1 --2- 172.21.15.135:0/2776108608 >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 0x7f04ec13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f2432640 1 -- 172.21.15.135:0/2776108608 >> v1:172.21.15.135:6789/0 conn(0x7f04ec1373a0 legacy=0x7f04ec137780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.704+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699586979 0 0) 0x7f04d4003520 con 0x7f04ec1373a0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.705+0000 7f04f2432640 1 -- 172.21.15.135:0/2776108608 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec071740 con 0x7f04ec13fcd0 2024-05-09T12:20:18.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.705+0000 7f04f1430640 1 --2- 172.21.15.135:0/2776108608 >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 0x7f04ec13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:18.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.705+0000 7f04f2432640 1 --2- 172.21.15.135:0/2776108608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 0x7f04ec1420c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73d6e6b2f42e07cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.705+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4037070 con 0x7f04ec13fcd0 2024-05-09T12:20:18.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e4030510 con 0x7f04ec13fcd0 2024-05-09T12:20:18.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f0c2f640 1 -- 172.21.15.135:0/2776108608 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e402be60 con 0x7f04ec13fcd0 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 -- 172.21.15.135:0/2776108608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 msgr2=0x7f04ec1420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2776108608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 0x7f04ec1420c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097a0 tx=0x7f04e402b660 comp rx=0 tx=0).stop 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 -- 172.21.15.135:0/2776108608 shutdown_connections 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2776108608 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec13fcd0 0x7f04ec1420c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2776108608 >> v2:172.21.15.160:3300/0 conn(0x7f04ec071fb0 0x7f04ec13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 -- 172.21.15.135:0/2776108608 >> 172.21.15.135:0/2776108608 conn(0x7f04ec0aba90 msgr2=0x7f04ec0abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 -- 172.21.15.135:0/2776108608 shutdown_connections 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.706+0000 7f04f3e95640 1 -- 172.21.15.135:0/2776108608 wait complete. 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.707+0000 7f04f3e95640 1 Processor -- start 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.707+0000 7f04f3e95640 1 -- start start 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec071fb0 0x7f04ec1cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04ec1373a0 0x7f04ec1cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec0736c0 con 0x7f04ec13fcd0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec073b10 con 0x7f04ec1373a0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec073840 con 0x7f04ec071fb0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44606/0 (socket says 172.21.15.135:44606) 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 -- 172.21.15.135:0/2376319597 learned_addr learned my addr 172.21.15.135:0/2376319597 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f1430640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04ec1373a0 0x7f04ec1cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f1c31640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec071fb0 0x7f04ec1cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 -- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec071fb0 msgr2=0x7f04ec1cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec071fb0 0x7f04ec1cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 -- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04ec1373a0 msgr2=0x7f04ec1cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04ec1373a0 0x7f04ec1cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 -- 172.21.15.135:0/2376319597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec0a38d0 con 0x7f04ec13fcd0 2024-05-09T12:20:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f2432640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04e4035040 tx=0x7f04e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4042020 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e403d670 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4037040 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ec0a3460 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.708+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ec0a2de0 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.709+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec069a50 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.710+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f04e4045020 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.710+0000 7f04ea7fc640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 0x7f04d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.710+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3482+0+0 (secure 0 0 0) 0x7f04e40b8690 con 0x7f04ec13fcd0 2024-05-09T12:20:18.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.710+0000 7f04f1c31640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 0x7f04d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:18.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.711+0000 7f04f1c31640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 0x7f04d8078790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0015a0 tx=0x7f04dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:18.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.715+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04e404c030 con 0x7f04ec13fcd0 2024-05-09T12:20:18.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:18.895+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f04ec0a3d70 con 0x7f04ec13fcd0 2024-05-09T12:20:19.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.606+0000 7f04ea7fc640 1 -- 172.21.15.135:0/2376319597 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) ==== 138+0+0 (secure 0 0 0) 0x7f04e40828b0 con 0x7f04ec13fcd0 2024-05-09T12:20:19.605 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 msgr2=0x7f04d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 0x7f04d8078790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0015a0 tx=0x7f04dc009040 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 msgr2=0x7f04ec1d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04e4035040 tx=0x7f04e40046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 shutdown_connections 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f04d80762d0 0x7f04d8078790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04ec13fcd0 0x7f04ec1d01a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04ec1373a0 0x7f04ec1cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 --2- 172.21.15.135:0/2376319597 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04ec071fb0 0x7f04ec1cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 >> 172.21.15.135:0/2376319597 conn(0x7f04ec0aba90 msgr2=0x7f04ec136250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:19.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 shutdown_connections 2024-05-09T12:20:19.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.609+0000 7f04f3e95640 1 -- 172.21.15.135:0/2376319597 wait complete. 2024-05-09T12:20:19.623 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T12:20:19.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.734+0000 7efef06af640 1 Processor -- start 2024-05-09T12:20:19.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.734+0000 7efef06af640 1 -- start start 2024-05-09T12:20:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efef06af640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efee813ce80 0x7efee813d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efef06af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efee806d1e0 0x7efee806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efef06af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee8073c50 con 0x7efee806dba0 2024-05-09T12:20:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efef06af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7efee8073f30 con 0x7efee806d1e0 2024-05-09T12:20:19.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efef06af640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7efee8073650 con 0x7efee813ce80 2024-05-09T12:20:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efee806d1e0 0x7efee806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efee806d1e0 0x7efee806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44610/0 (socket says 172.21.15.135:44610) 2024-05-09T12:20:19.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 -- 172.21.15.135:0/412490279 learned_addr learned my addr 172.21.15.135:0/412490279 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeee44b640 1 --2- 172.21.15.135:0/412490279 >> v2:172.21.15.160:3300/0 conn(0x7efee813ce80 0x7efee813d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 -- 172.21.15.135:0/412490279 >> v2:172.21.15.160:3300/0 conn(0x7efee813ce80 msgr2=0x7efee813d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 --2- 172.21.15.135:0/412490279 >> v2:172.21.15.160:3300/0 conn(0x7efee813ce80 0x7efee813d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 -- 172.21.15.135:0/412490279 >> v1:172.21.15.135:6789/0 conn(0x7efee806dba0 legacy=0x7efee8143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeedc4a640 1 -- 172.21.15.135:0/412490279 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee806f1f0 con 0x7efee806d1e0 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.735+0000 7efeed449640 1 -- 172.21.15.135:0/412490279 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455639575 0 0) 0x7efee8073c50 con 0x7efee806dba0 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.736+0000 7efeedc4a640 1 --2- 172.21.15.135:0/412490279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee806d1e0 0x7efee806d660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efee806e350 tx=0x7efed802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac57fd82d82c0ed7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.736+0000 7efeed449640 1 -- 172.21.15.135:0/412490279 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed802e070 con 0x7efee806d1e0 2024-05-09T12:20:19.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.736+0000 7efeed449640 1 -- 172.21.15.135:0/412490279 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8037070 con 0x7efee806d1e0 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.736+0000 7efeed449640 1 -- 172.21.15.135:0/412490279 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8031a00 con 0x7efee806d1e0 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 -- 172.21.15.135:0/412490279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee806d1e0 msgr2=0x7efee806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 --2- 172.21.15.135:0/412490279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee806d1e0 0x7efee806d660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efee806e350 tx=0x7efed802b880 comp rx=0 tx=0).stop 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 -- 172.21.15.135:0/412490279 shutdown_connections 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 --2- 172.21.15.135:0/412490279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee806d1e0 0x7efee806d660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 --2- 172.21.15.135:0/412490279 >> v2:172.21.15.160:3300/0 conn(0x7efee813ce80 0x7efee813d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 -- 172.21.15.135:0/412490279 >> 172.21.15.135:0/412490279 conn(0x7efee80aca30 msgr2=0x7efee80ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 -- 172.21.15.135:0/412490279 shutdown_connections 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.737+0000 7efef06af640 1 -- 172.21.15.135:0/412490279 wait complete. 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 Processor -- start 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 -- start start 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 0x7efee81d1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efee806dba0 0x7efee81d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efee8073990 con 0x7efee813ce80 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efee806dff0 con 0x7efee806d1e0 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efef06af640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efee80a9cb0 con 0x7efee806dba0 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44624/0 (socket says 172.21.15.135:44624) 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 -- 172.21.15.135:0/737112939 learned_addr learned my addr 172.21.15.135:0/737112939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:19.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeee44b640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 0x7efee81d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 -- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efee806dba0 msgr2=0x7efee81d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeedc4a640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efee806dba0 0x7efee81d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efee806dba0 0x7efee81d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 -- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 msgr2=0x7efee81d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 0x7efee81d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeeec4c640 1 -- 172.21.15.135:0/737112939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee80a7ee0 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.738+0000 7efeee44b640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 0x7efee81d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efeeec4c640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efee000c770 tx=0x7efee000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0003da0 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0005070 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee80a7940 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0005460 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.739+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee80a6a80 con 0x7efee813ce80 2024-05-09T12:20:19.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.740+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee806a470 con 0x7efee813ce80 2024-05-09T12:20:19.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.740+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efee0005600 con 0x7efee813ce80 2024-05-09T12:20:19.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.741+0000 7efedeffd640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 0x7efecc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:19.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.741+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3852+0+0 (secure 0 0 0) 0x7efee0096cf0 con 0x7efee813ce80 2024-05-09T12:20:19.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.741+0000 7efeee44b640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 0x7efecc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:19.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.741+0000 7efeee44b640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 0x7efecc078790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efee4006fd0 tx=0x7efee4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:19.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.746+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efee009b070 con 0x7efee813ce80 2024-05-09T12:20:19.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:19.928+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efee806efd0 con 0x7efee813ce80 2024-05-09T12:20:20.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.615+0000 7efedeffd640 1 -- 172.21.15.135:0/737112939 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) ==== 170+0+0 (secure 0 0 0) 0x7efee0060e20 con 0x7efee813ce80 2024-05-09T12:20:20.615 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-05-09T12:20:20.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.619+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 msgr2=0x7efecc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 0x7efecc078790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efee4006fd0 tx=0x7efee4008040 comp rx=0 tx=0).stop 2024-05-09T12:20:20.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 msgr2=0x7efee81d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efee000c770 tx=0x7efee000cc30 comp rx=0 tx=0).stop 2024-05-09T12:20:20.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 shutdown_connections 2024-05-09T12:20:20.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efecc0762d0 0x7efecc078790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee813ce80 0x7efee81d2380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efee806dba0 0x7efee81d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 --2- 172.21.15.135:0/737112939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efee806d1e0 0x7efee81d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 >> 172.21.15.135:0/737112939 conn(0x7efee80aca30 msgr2=0x7efee81c3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:20.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 shutdown_connections 2024-05-09T12:20:20.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.620+0000 7efef06af640 1 -- 172.21.15.135:0/737112939 wait complete. 2024-05-09T12:20:20.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T12:20:20.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.748+0000 7fcce56fa640 1 Processor -- start 2024-05-09T12:20:20.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.748+0000 7fcce56fa640 1 -- start start 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fcce56fa640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fcce013c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fcce56fa640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcce00a4900 0x7fcce00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fcce56fa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcce00a6c30 con 0x7fcce00a5ed0 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fcce56fa640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fcce00a2c60 con 0x7fcce00a4900 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fcce56fa640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcce00a40c0 con 0x7fcce013bd70 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccdf7fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fcce00a5ed0 0x7fcce0143ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54256/0 (socket says 172.21.15.135:54256) 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccdf7fe640 1 -- 172.21.15.135:0/3024374515 learned_addr learned my addr 172.21.15.135:0/3024374515 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccdeffd640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fcce013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccde7fc640 1 --2- 172.21.15.135:0/3024374515 >> v2:172.21.15.160:3300/0 conn(0x7fcce00a4900 0x7fcce00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496816231 0 0) 0x7fcce00a6c30 con 0x7fcce00a5ed0 2024-05-09T12:20:20.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.749+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc8003520 con 0x7fcce00a5ed0 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4241558558 0 0) 0x7fccc8003520 con 0x7fcce00a5ed0 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 msgr2=0x7fcce013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fcce013c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 >> v2:172.21.15.160:3300/0 conn(0x7fcce00a4900 msgr2=0x7fcce00a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 --2- 172.21.15.135:0/3024374515 >> v2:172.21.15.160:3300/0 conn(0x7fcce00a4900 0x7fcce00a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce00a3290 con 0x7fcce00a5ed0 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7fccd80016f0 con 0x7fcce00a5ed0 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 >> v1:172.21.15.135:6789/0 conn(0x7fcce00a5ed0 legacy=0x7fcce0143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fccc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc8004d40 0x7fccc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00a40c0 con 0x7fccc8004d40 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800ba70 con 0x7fccc8003a00 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fccc800bc70 con 0x7fcce013bd70 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccde7fc640 1 --2- 172.21.15.135:0/3024374515 >> v2:172.21.15.160:3300/0 conn(0x7fcce00a4900 0x7fcce00a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc8004d40 0x7fccc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdeffd640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccde7fc640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fccc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 -- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 msgr2=0x7fccc8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:20.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fccc8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 -- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8003a00 msgr2=0x7fccc8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8003a00 0x7fccc8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccdf7fe640 1 -- 172.21.15.135:0/3024374515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc8003520 con 0x7fccc8004d40 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.750+0000 7fccde7fc640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce013bd70 0x7fccc8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fccdf7fe640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc8004d40 0x7fccc80051c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c210 tx=0x7fccc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92822230f14923b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8007d50 con 0x7fccc8004d40 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd8030070 con 0x7fccc8004d40 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fccddffb640 1 -- 172.21.15.135:0/3024374515 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8005d10 con 0x7fccc8004d40 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 -- 172.21.15.135:0/3024374515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc8004d40 msgr2=0x7fccc80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 --2- 172.21.15.135:0/3024374515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccc8004d40 0x7fccc80051c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c210 tx=0x7fccc8005830 comp rx=0 tx=0).stop 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fccdf7fe640 1 -- 172.21.15.135:0/3024374515 reap_dead start 2024-05-09T12:20:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 -- 172.21.15.135:0/3024374515 shutdown_connections 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 -- 172.21.15.135:0/3024374515 >> 172.21.15.135:0/3024374515 conn(0x7fcce00aaf90 msgr2=0x7fcce00ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 -- 172.21.15.135:0/3024374515 shutdown_connections 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.751+0000 7fcce56fa640 1 -- 172.21.15.135:0/3024374515 wait complete. 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 Processor -- start 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 -- start start 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8004d40 0x7fcce01cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce01d20c0 0x7fcce01d2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00a2080 con 0x7fcce01cf010 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcce00a2f50 con 0x7fccc8004d40 2024-05-09T12:20:20.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fcce56fa640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcce0075510 con 0x7fcce01d20c0 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44648/0 (socket says 172.21.15.135:44648) 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 -- 172.21.15.135:0/620556490 learned_addr learned my addr 172.21.15.135:0/620556490 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccdeffd640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8004d40 0x7fcce01cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccdf7fe640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce01d20c0 0x7fcce01d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 -- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce01d20c0 msgr2=0x7fcce01d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce01d20c0 0x7fcce01d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 -- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8004d40 msgr2=0x7fcce01cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8004d40 0x7fcce01cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.753+0000 7fccde7fc640 1 -- 172.21.15.135:0/620556490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce0122fb0 con 0x7fcce01cf010 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fccde7fc640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccd4011900 tx=0x7fccd4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd400fbd0 con 0x7fcce01cf010 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd400fd70 con 0x7fcce01cf010 2024-05-09T12:20:20.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce0122a10 con 0x7fcce01cf010 2024-05-09T12:20:20.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4015680 con 0x7fcce01cf010 2024-05-09T12:20:20.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.754+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce0123c00 con 0x7fcce01cf010 2024-05-09T12:20:20.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.755+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce00508d0 con 0x7fcce01cf010 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.755+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccd4015820 con 0x7fcce01cf010 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.756+0000 7fccc77fe640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 0x7fcccc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.756+0000 7fccdeffd640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 0x7fcccc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.756+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4234+0+0 (secure 0 0 0) 0x7fccd4097a90 con 0x7fcce01cf010 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.756+0000 7fccdeffd640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 0x7fcccc078790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fccd0014450 tx=0x7fccd000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:20.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.760+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcce0122fb0 con 0x7fcce01cf010 2024-05-09T12:20:20.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:20.982+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcce00a7530 con 0x7fcce01cf010 2024-05-09T12:20:21.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.621+0000 7fccc77fe640 1 -- 172.21.15.135:0/620556490 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) ==== 172+0+0 (secure 0 0 0) 0x7fccd4019030 con 0x7fcce01cf010 2024-05-09T12:20:21.624 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 3 and data pool 4 2024-05-09T12:20:21.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 msgr2=0x7fcccc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 0x7fcccc078790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fccd0014450 tx=0x7fccd000b040 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 msgr2=0x7fcce01d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccd4011900 tx=0x7fccd4011dc0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 shutdown_connections 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcccc0762d0 0x7fcccc078790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce01d20c0 0x7fcce01d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce01cf010 0x7fcce01d1b80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 --2- 172.21.15.135:0/620556490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccc8004d40 0x7fcce01cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.632+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 >> 172.21.15.135:0/620556490 conn(0x7fcce00aaf90 msgr2=0x7fcce009c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.634+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 shutdown_connections 2024-05-09T12:20:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.634+0000 7fcce56fa640 1 -- 172.21.15.135:0/620556490 wait complete. 2024-05-09T12:20:21.651 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 Processor -- start 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 -- start start 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 0x7fe8dc13d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8dc06d1e0 0x7fe8dc06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8dc06dba0 0x7fe8dc143a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe8dc06e030 con 0x7fe8dc06dba0 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fe8dc073c50 con 0x7fe8dc06d1e0 2024-05-09T12:20:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.752+0000 7fe8e43b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe8dc073f30 con 0x7fe8dc13ce80 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8dc06dba0 0x7fe8dc143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8dc06dba0 0x7fe8dc143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44654/0 (socket says 172.21.15.135:44654) 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 -- 172.21.15.135:0/248380678 learned_addr learned my addr 172.21.15.135:0/248380678 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e1953640 1 --2- 172.21.15.135:0/248380678 >> v2:172.21.15.160:3300/0 conn(0x7fe8dc06d1e0 0x7fe8dc06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2154640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 0x7fe8dc13d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 -- 172.21.15.135:0/248380678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 msgr2=0x7fe8dc13d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 0x7fe8dc13d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 -- 172.21.15.135:0/248380678 >> v2:172.21.15.160:3300/0 conn(0x7fe8dc06d1e0 msgr2=0x7fe8dc06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 --2- 172.21.15.135:0/248380678 >> v2:172.21.15.160:3300/0 conn(0x7fe8dc06d1e0 0x7fe8dc06d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2955640 1 -- 172.21.15.135:0/248380678 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc073650 con 0x7fe8dc06dba0 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.753+0000 7fe8e2154640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 0x7fe8dc13d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e2955640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc06dba0 0x7fe8dc143a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc09f560 tx=0x7fe8d402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e600aee9d5b7ca0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:21.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e1152640 1 -- 172.21.15.135:0/248380678 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d402c950 con 0x7fe8dc06dba0 2024-05-09T12:20:21.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e1152640 1 -- 172.21.15.135:0/248380678 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d402caf0 con 0x7fe8dc06dba0 2024-05-09T12:20:21.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e1152640 1 -- 172.21.15.135:0/248380678 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40343f0 con 0x7fe8dc06dba0 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 -- 172.21.15.135:0/248380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc06dba0 msgr2=0x7fe8dc143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc06dba0 0x7fe8dc143a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc09f560 tx=0x7fe8d402bdb0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 -- 172.21.15.135:0/248380678 shutdown_connections 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc06dba0 0x7fe8dc143a10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/248380678 >> v2:172.21.15.160:3300/0 conn(0x7fe8dc06d1e0 0x7fe8dc06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/248380678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc13ce80 0x7fe8dc13d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 -- 172.21.15.135:0/248380678 >> 172.21.15.135:0/248380678 conn(0x7fe8dc0aca30 msgr2=0x7fe8dc0ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 -- 172.21.15.135:0/248380678 shutdown_connections 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.754+0000 7fe8e43b8640 1 -- 172.21.15.135:0/248380678 wait complete. 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.755+0000 7fe8e43b8640 1 Processor -- start 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.755+0000 7fe8e43b8640 1 -- start start 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8dc06d1e0 0x7fe8dc1d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc06dba0 0x7fe8dc1d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc073990 con 0x7fe8dc13ce80 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc06f1f0 con 0x7fe8dc06d1e0 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe8dc0a9cb0 con 0x7fe8dc06dba0 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44662/0 (socket says 172.21.15.135:44662) 2024-05-09T12:20:21.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 -- 172.21.15.135:0/3063950006 learned_addr learned my addr 172.21.15.135:0/3063950006 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e1953640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc06dba0 0x7fe8dc1d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2154640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8dc06d1e0 0x7fe8dc1d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 -- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc06dba0 msgr2=0x7fe8dc1d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc06dba0 0x7fe8dc1d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 -- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8dc06d1e0 msgr2=0x7fe8dc1d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8dc06d1e0 0x7fe8dc1d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 -- 172.21.15.135:0/3063950006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0a75c0 con 0x7fe8dc13ce80 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e2955640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4036040 tx=0x7fe8d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4043020 con 0x7fe8dc13ce80 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d403e450 con 0x7fe8dc13ce80 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d403e840 con 0x7fe8dc13ce80 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.756+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc0a7c90 con 0x7fe8dc13ce80 2024-05-09T12:20:21.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.757+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc0a6ab0 con 0x7fe8dc13ce80 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.757+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc0508d0 con 0x7fe8dc13ce80 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.758+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8d4046020 con 0x7fe8dc13ce80 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.758+0000 7fe8d2ffd640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 0x7fe8c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.759+0000 7fe8e2154640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 0x7fe8c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.759+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4334+0+0 (secure 0 0 0) 0x7fe8d40b9810 con 0x7fe8dc13ce80 2024-05-09T12:20:21.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.759+0000 7fe8e2154640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 0x7fe8c0078790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800aae0 tx=0x7fe8d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:21.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.763+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe8d404d030 con 0x7fe8dc13ce80 2024-05-09T12:20:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.943+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8dc06efd0 con 0x7fe8dc13ce80 2024-05-09T12:20:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.944+0000 7fe8d2ffd640 1 -- 172.21.15.135:0/3063950006 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+13594 (secure 0 0 0) 0x7fe8d4083110 con 0x7fe8dc13ce80 2024-05-09T12:20:21.943 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:21.943 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":16,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:20.983092+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 msgr2=0x7fe8c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 0x7fe8c0078790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800aae0 tx=0x7fe8d8008040 comp rx=0 tx=0).stop 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 msgr2=0x7fe8dc1d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4036040 tx=0x7fe8d4004a40 comp rx=0 tx=0).stop 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 shutdown_connections 2024-05-09T12:20:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe8c00762d0 0x7fe8c0078790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc13ce80 0x7fe8dc1d2520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8dc06dba0 0x7fe8dc1d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 --2- 172.21.15.135:0/3063950006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8dc06d1e0 0x7fe8dc1d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 >> 172.21.15.135:0/3063950006 conn(0x7fe8dc0aca30 msgr2=0x7fe8dc0ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 shutdown_connections 2024-05-09T12:20:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:21.946+0000 7fe8e43b8640 1 -- 172.21.15.135:0/3063950006 wait complete. 2024-05-09T12:20:21.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.057+0000 7fad0a0ff640 1 Processor -- start 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.057+0000 7fad0a0ff640 1 -- start start 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad0a0ff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fad04139e60 0x7fad04145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad0a0ff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0413a2b0 con 0x7fad040a6d80 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad0a0ff640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad040abd70 con 0x7fad04139a80 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad0a0ff640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fad040a8610 con 0x7fad04139e60 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad02ffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fad040a6d80 0x7fad040a9df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54258/0 (socket says 172.21.15.135:54258) 2024-05-09T12:20:22.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad02ffd640 1 -- 172.21.15.135:0/1727060107 learned_addr learned my addr 172.21.15.135:0/1727060107 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad03fff640 1 --2- 172.21.15.135:0/1727060107 >> v2:172.21.15.160:3300/0 conn(0x7fad04139e60 0x7fad04145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434066060 0 0) 0x7fad0413a2b0 con 0x7fad040a6d80 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facec003520 con 0x7fad040a6d80 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849806901 0 0) 0x7facec003520 con 0x7fad040a6d80 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 >> v2:172.21.15.160:3300/0 conn(0x7fad04139e60 msgr2=0x7fad04145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 --2- 172.21.15.135:0/1727060107 >> v2:172.21.15.160:3300/0 conn(0x7fad04139e60 0x7fad04145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 >> v1:172.21.15.160:6789/0 conn(0x7fad04139a80 legacy=0x7fad040a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad040a88d0 con 0x7fad040a6d80 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7facf80016f0 con 0x7fad040a6d80 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad03fff640 1 --2- 172.21.15.135:0/1727060107 >> v2:172.21.15.160:3300/0 conn(0x7fad04139e60 0x7fad04145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 >> v1:172.21.15.135:6789/0 conn(0x7fad040a6d80 legacy=0x7fad040a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec003a00 0x7facec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 0x7facec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facec0052e0 0x7facec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad040a8610 con 0x7facec004800 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7facec00c1b0 con 0x7facec0052e0 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7facec00c3b0 con 0x7facec003a00 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad02ffd640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 0x7facec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad037fe640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec003a00 0x7facec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.058+0000 7fad03fff640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facec0052e0 0x7facec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 -- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec003a00 msgr2=0x7facec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec003a00 0x7facec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 -- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facec0052e0 msgr2=0x7facec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facec0052e0 0x7facec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad03fff640 1 -- 172.21.15.135:0/1727060107 reap_dead start 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 -- 172.21.15.135:0/1727060107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec003520 con 0x7facec004800 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad037fe640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec003a00 0x7facec003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:22.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad02ffd640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 0x7facec004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facf8007fd0 tx=0x7facec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b37550bee85801a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8007d50 con 0x7facec004800 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf8030070 con 0x7facec004800 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.059+0000 7fad027fc640 1 -- 172.21.15.135:0/1727060107 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8005d50 con 0x7facec004800 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 -- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 msgr2=0x7facec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 0x7facec004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facf8007fd0 tx=0x7facec005830 comp rx=0 tx=0).stop 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 -- 172.21.15.135:0/1727060107 shutdown_connections 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/1727060107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facec004800 0x7facec004c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 -- 172.21.15.135:0/1727060107 >> 172.21.15.135:0/1727060107 conn(0x7fad040756c0 msgr2=0x7fad04075ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 -- 172.21.15.135:0/1727060107 shutdown_connections 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.060+0000 7fad0a0ff640 1 -- 172.21.15.135:0/1727060107 wait complete. 2024-05-09T12:20:22.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.061+0000 7fad0a0ff640 1 Processor -- start 2024-05-09T12:20:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.061+0000 7fad0a0ff640 1 -- start start 2024-05-09T12:20:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec004800 0x7fad041ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 0x7fad041d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad040abff0 con 0x7fad041cf2d0 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad040aa9e0 con 0x7fad041d2380 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fad040a7650 con 0x7facec004800 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44676/0 (socket says 172.21.15.135:44676) 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 -- 172.21.15.135:0/2241694483 learned_addr learned my addr 172.21.15.135:0/2241694483 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad03fff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 0x7fad041d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad037fe640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec004800 0x7fad041ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 -- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec004800 msgr2=0x7fad041ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec004800 0x7fad041ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 -- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 msgr2=0x7fad041d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 0x7fad041d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 -- 172.21.15.135:0/2241694483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad040a0990 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad03fff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 0x7fad041d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad02ffd640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facf8009000 tx=0x7facf80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8046070 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf80049e0 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8001c90 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0409ed80 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.062+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad040a0fe0 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.063+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad040508d0 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.064+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facf8007070 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.064+0000 7facebfff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 0x7facf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.065+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4334+0+0 (secure 0 0 0) 0x7facf80b8130 con 0x7fad041cf2d0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.065+0000 7fad037fe640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 0x7facf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.065+0000 7fad037fe640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 0x7facf0078790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7facf4007fd0 tx=0x7facf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.069+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7facf8081a30 con 0x7fad041cf2d0 2024-05-09T12:20:22.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.252+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad041ce930 con 0x7fad041cf2d0 2024-05-09T12:20:22.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.252+0000 7facebfff640 1 -- 172.21.15.135:0/2241694483 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+13594 (secure 0 0 0) 0x7facf8085d30 con 0x7fad041cf2d0 2024-05-09T12:20:22.252 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:22.252 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":16,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:20.983092+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:22.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 msgr2=0x7facf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 0x7facf0078790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7facf4007fd0 tx=0x7facf4009040 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 msgr2=0x7fad041d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7facf8009000 tx=0x7facf80019f0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 shutdown_connections 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7facf00762d0 0x7facf0078790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041d2380 0x7fad041d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad041cf2d0 0x7fad041d1e40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 --2- 172.21.15.135:0/2241694483 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facec004800 0x7fad041ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 >> 172.21.15.135:0/2241694483 conn(0x7fad040756c0 msgr2=0x7fad0413b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 shutdown_connections 2024-05-09T12:20:22.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.255+0000 7fad0a0ff640 1 -- 172.21.15.135:0/2241694483 wait complete. 2024-05-09T12:20:22.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.368+0000 7f086a2aa640 1 Processor -- start 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.368+0000 7f086a2aa640 1 -- start start 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f086a2aa640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f086413d2d0 0x7f0864141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f086a2aa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086406ca60 con 0x7f08641422c0 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f086a2aa640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086409d120 con 0x7f086413c7e0 2024-05-09T12:20:22.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f086a2aa640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f086409d3e0 con 0x7f086413d2d0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f0868847640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f08641422c0 0x7f08641446b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54268/0 (socket says 172.21.15.135:54268) 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f0868847640 1 -- 172.21.15.135:0/2649102924 learned_addr learned my addr 172.21.15.135:0/2649102924 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378792285 0 0) 0x7f086406ca60 con 0x7f08641422c0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f085bfff640 1 --2- 172.21.15.135:0/2649102924 >> v2:172.21.15.160:3300/0 conn(0x7f086413d2d0 0x7f0864141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0850003520 con 0x7f08641422c0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4015843053 0 0) 0x7f0850003520 con 0x7f08641422c0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 >> v2:172.21.15.160:3300/0 conn(0x7f086413d2d0 msgr2=0x7f0864141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 --2- 172.21.15.135:0/2649102924 >> v2:172.21.15.160:3300/0 conn(0x7f086413d2d0 0x7f0864141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 >> v1:172.21.15.160:6789/0 conn(0x7f086413c7e0 legacy=0x7f086413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086409f500 con 0x7f08641422c0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f085c001a90 con 0x7f08641422c0 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 >> v1:172.21.15.135:6789/0 conn(0x7f08641422c0 legacy=0x7f08641446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 0x7f0850003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850004800 0x7f0850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08500052e0 0x7f085000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f086409d3e0 con 0x7f0850003a50 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f085000c1b0 con 0x7f0850004800 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.369+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f085000c3b0 con 0x7f08500052e0 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 0x7f0850003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f085bfff640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850004800 0x7f0850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0868847640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08500052e0 0x7f085000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 -- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08500052e0 msgr2=0x7f085000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08500052e0 0x7f085000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 -- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850004800 msgr2=0x7f0850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850004800 0x7f0850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0863fff640 1 -- 172.21.15.135:0/2649102924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0850003520 con 0x7f0850003a50 2024-05-09T12:20:22.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.370+0000 7f0868847640 1 -- 172.21.15.135:0/2649102924 reap_dead start 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f0863fff640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 0x7f0850003e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0854001760 tx=0x7f0850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c799b921dc2f0569 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540013b0 con 0x7f0850003a50 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540052d0 con 0x7f0850003a50 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f08637fe640 1 -- 172.21.15.135:0/2649102924 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540037f0 con 0x7f0850003a50 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 -- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 msgr2=0x7f0850003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 0x7f0850003e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0854001760 tx=0x7f0850005830 comp rx=0 tx=0).stop 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 -- 172.21.15.135:0/2649102924 shutdown_connections 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 --2- 172.21.15.135:0/2649102924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0850003a50 0x7f0850003e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 -- 172.21.15.135:0/2649102924 >> 172.21.15.135:0/2649102924 conn(0x7f08640ab9b0 msgr2=0x7f08640abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 -- 172.21.15.135:0/2649102924 shutdown_connections 2024-05-09T12:20:22.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.371+0000 7f086a2aa640 1 -- 172.21.15.135:0/2649102924 wait complete. 2024-05-09T12:20:22.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.372+0000 7f086a2aa640 1 Processor -- start 2024-05-09T12:20:22.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.372+0000 7f086a2aa640 1 -- start start 2024-05-09T12:20:22.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850003a50 0x7f0864132550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08641d21e0 0x7f08641d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f08640a03c0 con 0x7f0864132a90 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08640a9110 con 0x7f0850003a50 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f086406c340 con 0x7f08641d21e0 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44690/0 (socket says 172.21.15.135:44690) 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 -- 172.21.15.135:0/522646524 learned_addr learned my addr 172.21.15.135:0/522646524 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f0863fff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850003a50 0x7f0864132550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f0868847640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08641d21e0 0x7f08641d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 -- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08641d21e0 msgr2=0x7f08641d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08641d21e0 0x7f08641d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 -- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850003a50 msgr2=0x7f0864132550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850003a50 0x7f0864132550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 -- 172.21.15.135:0/522646524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08640a8650 con 0x7f0864132a90 2024-05-09T12:20:22.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f085bfff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f084c011990 tx=0x7f084c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c00fa70 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c00fc10 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0864141140 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c014440 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.373+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086413fcd0 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.374+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08640508d0 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.375+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f084c012040 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.375+0000 7f08617fa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 0x7f08440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.375+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4334+0+0 (secure 0 0 0) 0x7f084c0973d0 con 0x7f0864132a90 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.375+0000 7f0863fff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 0x7f08440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.376+0000 7f0863fff640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 0x7f08440787c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0854033000 tx=0x7f0854009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.380+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f084c019030 con 0x7f0864132a90 2024-05-09T12:20:22.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.602+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f086409cbf0 con 0x7f0864132a90 2024-05-09T12:20:22.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.627+0000 7f08617fa640 1 -- 172.21.15.135:0/522646524 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f084c060cd0 con 0x7f0864132a90 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 msgr2=0x7f08440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 0x7f08440787c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0854033000 tx=0x7f0854009030 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 msgr2=0x7f08641d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f084c011990 tx=0x7f084c011e50 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 shutdown_connections 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0844076300 0x7f08440787c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08641d21e0 0x7f08641d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0864132a90 0x7f08641d1ca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 --2- 172.21.15.135:0/522646524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0850003a50 0x7f0864132550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 >> 172.21.15.135:0/522646524 conn(0x7f08640ab9b0 msgr2=0x7f0864136670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:22.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 shutdown_connections 2024-05-09T12:20:22.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.631+0000 7f086a2aa640 1 -- 172.21.15.135:0/522646524 wait complete. 2024-05-09T12:20:22.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-09T12:20:22.642 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T12:20:22.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.744+0000 7fc5e3e5e640 1 Processor -- start 2024-05-09T12:20:22.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.744+0000 7fc5e3e5e640 1 -- start start 2024-05-09T12:20:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e3e5e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5dc139a80 0x7fc5dc139e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e3e5e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5dc0abd70 con 0x7fc5dc0a6d80 2024-05-09T12:20:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e3e5e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5dc0a88d0 con 0x7fc5dc0a9df0 2024-05-09T12:20:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e3e5e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc5dc0a8610 con 0x7fc5dc139a80 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e1bfa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5dc139a80 0x7fc5dc139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e13f9640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc5dc0a6d80 0x7fc5dc0a96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37094/0 (socket says 172.21.15.135:37094) 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e13f9640 1 -- 172.21.15.135:0/416474765 learned_addr learned my addr 172.21.15.135:0/416474765 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e1bfa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5dc139a80 0x7fc5dc139e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40816/0 (socket says 172.21.15.135:40816) 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e1bfa640 1 -- 172.21.15.135:0/416474765 >> v1:172.21.15.160:6789/0 conn(0x7fc5dc0a9df0 legacy=0x7fc5dc144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e1bfa640 1 -- 172.21.15.135:0/416474765 >> v1:172.21.15.135:6789/0 conn(0x7fc5dc0a6d80 legacy=0x7fc5dc0a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e1bfa640 1 -- 172.21.15.135:0/416474765 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc0a6250 con 0x7fc5dc139a80 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.745+0000 7fc5e0bf8640 1 -- 172.21.15.135:0/416474765 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855883222 0 0) 0x7fc5cc001110 con 0x7fc5dc0a6d80 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.746+0000 7fc5e1bfa640 1 --2- 172.21.15.135:0/416474765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc139e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80097a0 tx=0x7fc5d802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b26a56cffd3ec31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.746+0000 7fc5e0bf8640 1 -- 172.21.15.135:0/416474765 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8038070 con 0x7fc5dc139a80 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.746+0000 7fc5e0bf8640 1 -- 172.21.15.135:0/416474765 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d8031700 con 0x7fc5dc139a80 2024-05-09T12:20:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.746+0000 7fc5e0bf8640 1 -- 172.21.15.135:0/416474765 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8031ad0 con 0x7fc5dc139a80 2024-05-09T12:20:22.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/416474765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 msgr2=0x7fc5dc139e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/416474765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc139e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80097a0 tx=0x7fc5d802b7a0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/416474765 shutdown_connections 2024-05-09T12:20:22.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/416474765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc139e60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/416474765 >> 172.21.15.135:0/416474765 conn(0x7fc5dc0756c0 msgr2=0x7fc5dc075ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:22.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/416474765 shutdown_connections 2024-05-09T12:20:22.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.747+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/416474765 wait complete. 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 Processor -- start 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 -- start start 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 0x7fc5dc138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 0x7fc5dc138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc0abff0 con 0x7fc5dc139a80 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc0aa9e0 con 0x7fc5dc0a6d80 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e3e5e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc0a7650 con 0x7fc5dc0a9df0 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e23fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e23fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40832/0 (socket says 172.21.15.135:40832) 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e23fb640 1 -- 172.21.15.135:0/1005377007 learned_addr learned my addr 172.21.15.135:0/1005377007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:22.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e1bfa640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 0x7fc5dc138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.748+0000 7fc5e13f9640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 0x7fc5dc138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 -- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 msgr2=0x7fc5dc138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 0x7fc5dc138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 -- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 msgr2=0x7fc5dc138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 0x7fc5dc138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 -- 172.21.15.135:0/1005377007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc0a0db0 con 0x7fc5dc139a80 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e13f9640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 0x7fc5dc138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e1bfa640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 0x7fc5dc138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e23fb640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c780 tx=0x7fc5d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4004b60 con 0x7fc5dc139a80 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d4004d00 con 0x7fc5dc139a80 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400aa90 con 0x7fc5dc139a80 2024-05-09T12:20:22.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5dc0a0920 con 0x7fc5dc139a80 2024-05-09T12:20:22.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.749+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5dc0a0060 con 0x7fc5dc139a80 2024-05-09T12:20:22.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.750+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5dc0a12b0 con 0x7fc5dc139a80 2024-05-09T12:20:22.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.750+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5d400ac30 con 0x7fc5dc139a80 2024-05-09T12:20:22.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.751+0000 7fc5d27fc640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 0x7fc5c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:22.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.751+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fc5d4097290 con 0x7fc5dc139a80 2024-05-09T12:20:22.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.751+0000 7fc5e1bfa640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 0x7fc5c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:22.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.751+0000 7fc5e1bfa640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 0x7fc5c0078790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8035000 tx=0x7fc5d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:22.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.755+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc5d4020070 con 0x7fc5dc139a80 2024-05-09T12:20:22.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:22.974+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5dc0508d0 con 0x7fc5dc139a80 2024-05-09T12:20:23.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.632+0000 7fc5d27fc640 1 -- 172.21.15.135:0/1005377007 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fc5d40611e0 con 0x7fc5dc139a80 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 msgr2=0x7fc5c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 0x7fc5c0078790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8035000 tx=0x7fc5d8008030 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 msgr2=0x7fc5dc1d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c780 tx=0x7fc5d400cc40 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 shutdown_connections 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc5c00762d0 0x7fc5c0078790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5dc139a80 0x7fc5dc1d2090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc5dc0a9df0 0x7fc5dc138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 --2- 172.21.15.135:0/1005377007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc5dc0a6d80 0x7fc5dc138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 >> 172.21.15.135:0/1005377007 conn(0x7fc5dc0756c0 msgr2=0x7fc5dc1c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 shutdown_connections 2024-05-09T12:20:23.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.635+0000 7fc5e3e5e640 1 -- 172.21.15.135:0/1005377007 wait complete. 2024-05-09T12:20:23.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T12:20:23.648 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:23.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 Processor -- start 2024-05-09T12:20:23.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 -- start start 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3bc06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb3bc142a10 0x7fb3bc144e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc073c50 con 0x7fb3bc13ce80 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc073f30 con 0x7fb3bc142a10 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3c086f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc073650 con 0x7fb3bc13d260 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3ba59c640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb3bc13ce80 0x7fb3bc06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37100/0 (socket says 172.21.15.135:37100) 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.753+0000 7fb3ba59c640 1 -- 172.21.15.135:0/388391973 learned_addr learned my addr 172.21.15.135:0/388391973 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324308705 0 0) 0x7fb3bc073c50 con 0x7fb3bc13ce80 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/388391973 >> v2:172.21.15.160:3300/0 conn(0x7fb3bc142a10 0x7fb3bc144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3a4003520 con 0x7fb3bc13ce80 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3bc06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435257550 0 0) 0x7fb3a4003520 con 0x7fb3bc13ce80 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 msgr2=0x7fb3bc06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3bc06d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 >> v2:172.21.15.160:3300/0 conn(0x7fb3bc142a10 msgr2=0x7fb3bc144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 --2- 172.21.15.135:0/388391973 >> v2:172.21.15.160:3300/0 conn(0x7fb3bc142a10 0x7fb3bc144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc06f1f0 con 0x7fb3bc13ce80 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7fb3b40016f0 con 0x7fb3bc13ce80 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 >> v1:172.21.15.135:6789/0 conn(0x7fb3bc13ce80 legacy=0x7fb3bc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3a4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a4003fd0 0x7fb3a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4004d40 0x7fb3a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc073f30 con 0x7fb3a4003fd0 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc073650 con 0x7fb3a4004d40 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a400bb50 con 0x7fb3bc13d260 2024-05-09T12:20:23.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a4003fd0 0x7fb3a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3ba59c640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3a4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4004d40 0x7fb3a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 -- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 msgr2=0x7fb3a4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3a4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 -- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4004d40 msgr2=0x7fb3a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4004d40 0x7fb3a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3b9d9b640 1 -- 172.21.15.135:0/388391973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a4003520 con 0x7fb3a4003fd0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4004d40 0x7fb3a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.754+0000 7fb3ba59c640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc13d260 0x7fb3a4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.755+0000 7fb3b9d9b640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a4003fd0 0x7fb3a4004800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009fc0 tx=0x7fb3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6551ed844d053 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.755+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0039070 con 0x7fb3a4003fd0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.755+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b002cc20 con 0x7fb3a4003fd0 2024-05-09T12:20:23.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.755+0000 7fb3b959a640 1 -- 172.21.15.135:0/388391973 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0009c10 con 0x7fb3a4003fd0 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 -- 172.21.15.135:0/388391973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a4003fd0 msgr2=0x7fb3a4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 --2- 172.21.15.135:0/388391973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3a4003fd0 0x7fb3a4004800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009fc0 tx=0x7fb3a4005830 comp rx=0 tx=0).stop 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3bad9d640 1 -- 172.21.15.135:0/388391973 reap_dead start 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 -- 172.21.15.135:0/388391973 shutdown_connections 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 -- 172.21.15.135:0/388391973 >> 172.21.15.135:0/388391973 conn(0x7fb3bc0aca30 msgr2=0x7fb3bc0ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 -- 172.21.15.135:0/388391973 shutdown_connections 2024-05-09T12:20:23.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.756+0000 7fb3c086f640 1 -- 172.21.15.135:0/388391973 wait complete. 2024-05-09T12:20:23.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.757+0000 7fb3c086f640 1 Processor -- start 2024-05-09T12:20:23.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.757+0000 7fb3c086f640 1 -- start start 2024-05-09T12:20:23.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.757+0000 7fb3c086f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4003fd0 0x7fb3bc1d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.757+0000 7fb3c086f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc1d2460 0x7fb3bc1d2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.757+0000 7fb3c086f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3c086f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0a9cb0 con 0x7fb3bc133180 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3c086f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc073990 con 0x7fb3a4003fd0 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3c086f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc073380 con 0x7fb3bc1d2460 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40854/0 (socket says 172.21.15.135:40854) 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 -- 172.21.15.135:0/1488993622 learned_addr learned my addr 172.21.15.135:0/1488993622 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3ba59c640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4003fd0 0x7fb3bc1d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 -- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc1d2460 msgr2=0x7fb3bc1d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc1d2460 0x7fb3bc1d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 -- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4003fd0 msgr2=0x7fb3bc1d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4003fd0 0x7fb3bc1d1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 -- 172.21.15.135:0/1488993622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc1417e0 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3bad9d640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06e210 tx=0x7fb3ac011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac019020 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac003610 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc137710 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003a00 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.758+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc0a1660 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.759+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc13b160 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.760+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb3ac01c020 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.760+0000 7fb3aaffd640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 0x7fb39c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.760+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fb3ac097190 con 0x7fb3bc133180 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.760+0000 7fb3ba59c640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 0x7fb39c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:23.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.761+0000 7fb3ba59c640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 0x7fb39c0787c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4001160 tx=0x7fb3b4001b00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:23.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.765+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb3ac023030 con 0x7fb3bc133180 2024-05-09T12:20:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.980+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3bc0508d0 con 0x7fb3bc133180 2024-05-09T12:20:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.981+0000 7fb3aaffd640 1 -- 172.21.15.135:0/1488993622 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7fb3ac0610e0 con 0x7fb3bc133180 2024-05-09T12:20:23.980 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:23.980 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:20:23.981 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:20:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 msgr2=0x7fb39c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 0x7fb39c0787c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4001160 tx=0x7fb3b4001b00 comp rx=0 tx=0).stop 2024-05-09T12:20:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 msgr2=0x7fb3bc133600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:23.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06e210 tx=0x7fb3ac011920 comp rx=0 tx=0).stop 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 shutdown_connections 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb39c076300 0x7fb39c0787c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3bc133180 0x7fb3bc133600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3bc1d2460 0x7fb3bc1d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 --2- 172.21.15.135:0/1488993622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3a4003fd0 0x7fb3bc1d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 >> 172.21.15.135:0/1488993622 conn(0x7fb3bc0aca30 msgr2=0x7fb3bc0aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 shutdown_connections 2024-05-09T12:20:23.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:23.983+0000 7fb3c086f640 1 -- 172.21.15.135:0/1488993622 wait complete. 2024-05-09T12:20:23.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 Processor -- start 2024-05-09T12:20:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 -- start start 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8013ce80 0x7f6e8013d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e8006dd70 0x7f6e80144a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e80073c50 con 0x7f6e8006d1e0 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6e80073f30 con 0x7f6e8006dd70 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e87596640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6e80073650 con 0x7f6e8013ce80 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e85b33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e8006dd70 0x7f6e80144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e85b33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e8006dd70 0x7f6e80144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40870/0 (socket says 172.21.15.135:40870) 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.093+0000 7f6e85b33640 1 -- 172.21.15.135:0/1565912293 learned_addr learned my addr 172.21.15.135:0/1565912293 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85332640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8013ce80 0x7f6e8013d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85b33640 1 -- 172.21.15.135:0/1565912293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8013ce80 msgr2=0x7f6e8013d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85b33640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8013ce80 0x7f6e8013d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85b33640 1 -- 172.21.15.135:0/1565912293 >> v1:172.21.15.160:6789/0 conn(0x7f6e8006d1e0 legacy=0x7f6e8006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85b33640 1 -- 172.21.15.135:0/1565912293 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8006f1f0 con 0x7f6e8006dd70 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.094+0000 7f6e85b33640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8006dd70 0x7f6e80144a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009870 tx=0x7f6e7802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6d9d756d457603 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e77fff640 1 -- 172.21.15.135:0/1565912293 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780317c0 con 0x7f6e8006dd70 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e77fff640 1 -- 172.21.15.135:0/1565912293 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e78037070 con 0x7f6e8006dd70 2024-05-09T12:20:24.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e77fff640 1 -- 172.21.15.135:0/1565912293 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78031b80 con 0x7f6e8006dd70 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 -- 172.21.15.135:0/1565912293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8006dd70 msgr2=0x7f6e80144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8006dd70 0x7f6e80144a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009870 tx=0x7f6e7802b860 comp rx=0 tx=0).stop 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 -- 172.21.15.135:0/1565912293 shutdown_connections 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8006dd70 0x7f6e80144a20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 --2- 172.21.15.135:0/1565912293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8013ce80 0x7f6e8013d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 -- 172.21.15.135:0/1565912293 >> 172.21.15.135:0/1565912293 conn(0x7f6e800aca30 msgr2=0x7f6e800ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 -- 172.21.15.135:0/1565912293 shutdown_connections 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.095+0000 7f6e87596640 1 -- 172.21.15.135:0/1565912293 wait complete. 2024-05-09T12:20:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.096+0000 7f6e87596640 1 Processor -- start 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.096+0000 7f6e87596640 1 -- start start 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8006d1e0 0x7f6e80137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e8006dd70 0x7f6e80137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e800a9cb0 con 0x7f6e8013ce80 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6e80073990 con 0x7f6e8006dd70 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6e80073380 con 0x7f6e8006d1e0 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40874/0 (socket says 172.21.15.135:40874) 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85332640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8006d1e0 0x7f6e80137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 -- 172.21.15.135:0/2513023225 learned_addr learned my addr 172.21.15.135:0/2513023225 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e84b31640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e8006dd70 0x7f6e80137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 -- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8006d1e0 msgr2=0x7f6e80137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8006d1e0 0x7f6e80137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 -- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e8006dd70 msgr2=0x7f6e80137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e8006dd70 0x7f6e80137a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 -- 172.21.15.135:0/2513023225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e800a5210 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e85b33640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009870 tx=0x7f6e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78032860 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e78032a00 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e800a6ca0 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.097+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78032df0 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.098+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e80137f90 con 0x7f6e8013ce80 2024-05-09T12:20:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.099+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e800508d0 con 0x7f6e8013ce80 2024-05-09T12:20:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.099+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6e7804c060 con 0x7f6e8013ce80 2024-05-09T12:20:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.100+0000 7f6e75ffb640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 0x7f6e64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.100+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f6e780b8a50 con 0x7f6e8013ce80 2024-05-09T12:20:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.100+0000 7f6e85332640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 0x7f6e64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.100+0000 7f6e85332640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 0x7f6e64078790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c003b80 tx=0x7f6e7c0098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.104+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6e78040070 con 0x7f6e8013ce80 2024-05-09T12:20:24.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.289+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e8006efd0 con 0x7f6e8013ce80 2024-05-09T12:20:24.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.290+0000 7f6e75ffb640 1 -- 172.21.15.135:0/2513023225 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+13581 (secure 0 0 0) 0x7f6e78031e90 con 0x7f6e8013ce80 2024-05-09T12:20:24.289 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:24.290 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:22.622854+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 msgr2=0x7f6e64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 0x7f6e64078790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c003b80 tx=0x7f6e7c0098d0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 msgr2=0x7f6e801ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009870 tx=0x7f6e780046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 shutdown_connections 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f6e640762d0 0x7f6e64078790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e8013ce80 0x7f6e801ce860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e8006dd70 0x7f6e80137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 --2- 172.21.15.135:0/2513023225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6e8006d1e0 0x7f6e80137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 >> 172.21.15.135:0/2513023225 conn(0x7f6e800aca30 msgr2=0x7f6e801397b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 shutdown_connections 2024-05-09T12:20:24.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.292+0000 7f6e87596640 1 -- 172.21.15.135:0/2513023225 wait complete. 2024-05-09T12:20:24.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T12:20:24.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 Processor -- start 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 -- start start 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 0x7fc41013cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc41009b3d0 0x7fc41013d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc4101393c0 0x7fc410139850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc41009c2a0 con 0x7fc41009b3d0 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fc41013d6b0 con 0x7fc4101393c0 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.402+0000 7fc415483640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc41009cdf0 con 0x7fc41013c850 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc41009b3d0 0x7fc41013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc41009b3d0 0x7fc41013d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40876/0 (socket says 172.21.15.135:40876) 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 -- 172.21.15.135:0/1458799145 learned_addr learned my addr 172.21.15.135:0/1458799145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc40f7fe640 1 --2- 172.21.15.135:0/1458799145 >> v2:172.21.15.160:3300/0 conn(0x7fc4101393c0 0x7fc410139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc40effd640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 0x7fc41013cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 -- 172.21.15.135:0/1458799145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 msgr2=0x7fc41013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 0x7fc41013cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 -- 172.21.15.135:0/1458799145 >> v2:172.21.15.160:3300/0 conn(0x7fc4101393c0 msgr2=0x7fc410139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 --2- 172.21.15.135:0/1458799145 >> v2:172.21.15.160:3300/0 conn(0x7fc4101393c0 0x7fc410139850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc4067fc640 1 -- 172.21.15.135:0/1458799145 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4100a09a0 con 0x7fc41009b3d0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.403+0000 7fc40effd640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 0x7fc41013cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc4067fc640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc41013d170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80098a0 tx=0x7fc3f802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a8bc4d6324d21f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc40e7fc640 1 -- 172.21.15.135:0/1458799145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8038070 con 0x7fc41009b3d0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc40e7fc640 1 -- 172.21.15.135:0/1458799145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f8031520 con 0x7fc41009b3d0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc40e7fc640 1 -- 172.21.15.135:0/1458799145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80318f0 con 0x7fc41009b3d0 2024-05-09T12:20:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 -- 172.21.15.135:0/1458799145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 msgr2=0x7fc41013d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc41013d170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80098a0 tx=0x7fc3f802b7c0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 -- 172.21.15.135:0/1458799145 shutdown_connections 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 --2- 172.21.15.135:0/1458799145 >> v2:172.21.15.160:3300/0 conn(0x7fc4101393c0 0x7fc410139850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc41013d170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 --2- 172.21.15.135:0/1458799145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41013c850 0x7fc41013cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 -- 172.21.15.135:0/1458799145 >> 172.21.15.135:0/1458799145 conn(0x7fc410075cf0 msgr2=0x7fc4100aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 -- 172.21.15.135:0/1458799145 shutdown_connections 2024-05-09T12:20:24.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.404+0000 7fc415483640 1 -- 172.21.15.135:0/1458799145 wait complete. 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.405+0000 7fc415483640 1 Processor -- start 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.405+0000 7fc415483640 1 -- start start 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4101393c0 0x7fc410138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc41013c850 0x7fc4101d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc41009e670 con 0x7fc41009b3d0 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc41009bc70 con 0x7fc41013c850 2024-05-09T12:20:24.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc415483640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc41009aa20 con 0x7fc4101393c0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40886/0 (socket says 172.21.15.135:40886) 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 -- 172.21.15.135:0/3048376179 learned_addr learned my addr 172.21.15.135:0/3048376179 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40f7fe640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc41013c850 0x7fc4101d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc4067fc640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4101393c0 0x7fc410138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 -- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4101393c0 msgr2=0x7fc410138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4101393c0 0x7fc410138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 -- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc41013c850 msgr2=0x7fc4101d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc41013c850 0x7fc4101d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 -- 172.21.15.135:0/3048376179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101391f0 con 0x7fc41009b3d0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc40effd640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc40000d800 tx=0x7fc40000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400004030 con 0x7fc41009b3d0 2024-05-09T12:20:24.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.406+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4000041d0 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.407+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40000b6c0 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.407+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4100a7700 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.407+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4100a79c0 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.408+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4100a1d50 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.408+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc40000b860 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.408+0000 7fc407fff640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 0x7fc3f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.409+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fc400097040 con 0x7fc41009b3d0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.409+0000 7fc4067fc640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 0x7fc3f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.409+0000 7fc4067fc640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 0x7fc3f0078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8035000 tx=0x7fc3f8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.413+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc4100a1d50 con 0x7fc41009b3d0 2024-05-09T12:20:24.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.591+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4100508d0 con 0x7fc3f00762d0 2024-05-09T12:20:24.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.598+0000 7fc407fff640 1 -- 172.21.15.135:0/3048376179 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255593 (secure 0 0 0) 0x7fc4100508d0 con 0x7fc3f00762d0 2024-05-09T12:20:24.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:24.603 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:24.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 msgr2=0x7fc3f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 0x7fc3f0078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8035000 tx=0x7fc3f8030000 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 msgr2=0x7fc410138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc40000d800 tx=0x7fc40000dcc0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 shutdown_connections 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc3f00762d0 0x7fc3f0078790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc41013c850 0x7fc4101d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4101393c0 0x7fc410138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 --2- 172.21.15.135:0/3048376179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc41009b3d0 0x7fc410138770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 >> 172.21.15.135:0/3048376179 conn(0x7fc410075cf0 msgr2=0x7fc41009d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 shutdown_connections 2024-05-09T12:20:24.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.601+0000 7fc415483640 1 -- 172.21.15.135:0/3048376179 wait complete. 2024-05-09T12:20:24.611 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-09T12:20:23.374118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110196,"kb_used_data":1608,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377164,"statfs":{"total":386547056640,"available":386434215936,"internally_reserved":0,"allocated":1646592,"data_stored":1318124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.764776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599708+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:17.599708+0000","last_peered":"2024-05-09T12:20:17.599708+0000","last_clean":"2024-05-09T12:20:17.599708+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:17.599708+0000","last_undegraded":"2024-05-09T12:20:17.599708+0000","last_fullsized":"2024-05-09T12:20:17.599708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599615+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:17.599615+0000","last_peered":"2024-05-09T12:20:17.599615+0000","last_clean":"2024-05-09T12:20:17.599615+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:17.599615+0000","last_undegraded":"2024-05-09T12:20:17.599615+0000","last_fullsized":"2024-05-09T12:20:17.599615+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599608+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:17.599608+0000","last_peered":"2024-05-09T12:20:17.599608+0000","last_clean":"2024-05-09T12:20:17.599608+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:17.599608+0000","last_undegraded":"2024-05-09T12:20:17.599608+0000","last_fullsized":"2024-05-09T12:20:17.599608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601098+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:17.601098+0000","last_peered":"2024-05-09T12:20:17.601098+0000","last_clean":"2024-05-09T12:20:17.601098+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:17.601098+0000","last_undegraded":"2024-05-09T12:20:17.601098+0000","last_fullsized":"2024-05-09T12:20:17.601098+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":102,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599791+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:17.599791+0000","last_peered":"2024-05-09T12:20:17.599791+0000","last_clean":"2024-05-09T12:20:17.599791+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:17.599791+0000","last_undegraded":"2024-05-09T12:20:17.599791+0000","last_fullsized":"2024-05-09T12:20:17.599791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601084+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:17.601084+0000","last_peered":"2024-05-09T12:20:17.601084+0000","last_clean":"2024-05-09T12:20:17.601084+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:17.601084+0000","last_undegraded":"2024-05-09T12:20:17.601084+0000","last_fullsized":"2024-05-09T12:20:17.601084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599645+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:17.599645+0000","last_peered":"2024-05-09T12:20:17.599645+0000","last_clean":"2024-05-09T12:20:17.599645+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:17.599645+0000","last_undegraded":"2024-05-09T12:20:17.599645+0000","last_fullsized":"2024-05-09T12:20:17.599645+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599747+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:17.599747+0000","last_peered":"2024-05-09T12:20:17.599747+0000","last_clean":"2024-05-09T12:20:17.599747+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:17.599747+0000","last_undegraded":"2024-05-09T12:20:17.599747+0000","last_fullsized":"2024-05-09T12:20:17.599747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599824+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:17.599824+0000","last_peered":"2024-05-09T12:20:17.599824+0000","last_clean":"2024-05-09T12:20:17.599824+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:17.599824+0000","last_undegraded":"2024-05-09T12:20:17.599824+0000","last_fullsized":"2024-05-09T12:20:17.599824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:24.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.753+0000 7fb68eb93640 1 Processor -- start 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.753+0000 7fb68eb93640 1 -- start start 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb688139910 0x7fb688139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 0x7fb68813cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 0x7fb688143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb68809dbe0 con 0x7fb688139910 2024-05-09T12:20:24.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fb68809d750 con 0x7fb68813d130 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68eb93640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb688139200 con 0x7fb68813c770 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb688139910 0x7fb688139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb688139910 0x7fb688139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40900/0 (socket says 172.21.15.135:40900) 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 -- 172.21.15.135:0/2763140774 learned_addr learned my addr 172.21.15.135:0/2763140774 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68d130640 1 --2- 172.21.15.135:0/2763140774 >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 0x7fb688143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb687fff640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 0x7fb68813cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 -- 172.21.15.135:0/2763140774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 msgr2=0x7fb68813cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 0x7fb68813cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 -- 172.21.15.135:0/2763140774 >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 msgr2=0x7fb688143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 --2- 172.21.15.135:0/2763140774 >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 0x7fb688143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68c92f640 1 -- 172.21.15.135:0/2763140774 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68809de00 con 0x7fb688139910 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb68d130640 1 --2- 172.21.15.135:0/2763140774 >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 0x7fb688143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:24.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.754+0000 7fb687fff640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 0x7fb68813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:24.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.755+0000 7fb68c92f640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb688139910 0x7fb688139cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6880a9530 tx=0x7fb67802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0cc58658c6a582 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.755+0000 7fb6877fe640 1 -- 172.21.15.135:0/2763140774 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678038070 con 0x7fb688139910 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.755+0000 7fb6877fe640 1 -- 172.21.15.135:0/2763140774 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678031740 con 0x7fb688139910 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.755+0000 7fb6877fe640 1 -- 172.21.15.135:0/2763140774 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67802f050 con 0x7fb688139910 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 -- 172.21.15.135:0/2763140774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb688139910 msgr2=0x7fb688139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb688139910 0x7fb688139cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6880a9530 tx=0x7fb67802b7e0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 -- 172.21.15.135:0/2763140774 shutdown_connections 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813c770 0x7fb68813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 --2- 172.21.15.135:0/2763140774 >> v2:172.21.15.160:3300/0 conn(0x7fb68813d130 0x7fb688143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 --2- 172.21.15.135:0/2763140774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb688139910 0x7fb688139cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 -- 172.21.15.135:0/2763140774 >> 172.21.15.135:0/2763140774 conn(0x7fb6880ab940 msgr2=0x7fb6880abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 -- 172.21.15.135:0/2763140774 shutdown_connections 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.756+0000 7fb68eb93640 1 -- 172.21.15.135:0/2763140774 wait complete. 2024-05-09T12:20:24.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 Processor -- start 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 -- start start 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb688139910 0x7fb6881d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813d130 0x7fb6881d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb68809f490 con 0x7fb68813c770 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.757+0000 7fb68eb93640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb68813d5c0 con 0x7fb688139910 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb68eb93640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb68806ced0 con 0x7fb68813d130 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40914/0 (socket says 172.21.15.135:40914) 2024-05-09T12:20:24.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 -- 172.21.15.135:0/1066966411 learned_addr learned my addr 172.21.15.135:0/1066966411 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb68c92f640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb688139910 0x7fb6881d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb68d130640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813d130 0x7fb6881d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 -- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813d130 msgr2=0x7fb6881d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813d130 0x7fb6881d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 -- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb688139910 msgr2=0x7fb6881d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb688139910 0x7fb6881d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 -- 172.21.15.135:0/1066966411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880a30c0 con 0x7fb68813c770 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb687fff640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e840 tx=0x7fb67c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00f040 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c004030 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6880a2710 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c004400 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.758+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6880a7c10 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.759+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6880a4b30 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.760+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb67c00c6d0 con 0x7fb68813c770 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.760+0000 7fb6857fa640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 0x7fb674078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.760+0000 7fb68c92f640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 0x7fb674078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:24.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.760+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fb67c096c60 con 0x7fb68813c770 2024-05-09T12:20:24.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.761+0000 7fb68c92f640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 0x7fb674078790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb678035000 tx=0x7fb678008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:24.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.764+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6880a4b30 con 0x7fb68813c770 2024-05-09T12:20:24.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.940+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6880508d0 con 0x7fb6740762d0 2024-05-09T12:20:24.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.946+0000 7fb6857fa640 1 -- 172.21.15.135:0/1066966411 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255593 (secure 0 0 0) 0x7fb6880508d0 con 0x7fb6740762d0 2024-05-09T12:20:24.948 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:24.949 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 msgr2=0x7fb674078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 0x7fb674078790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb678035000 tx=0x7fb678008030 comp rx=0 tx=0).stop 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 msgr2=0x7fb6881d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e840 tx=0x7fb67c00ed00 comp rx=0 tx=0).stop 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 shutdown_connections 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb6740762d0 0x7fb674078790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68813d130 0x7fb6881d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb68813c770 0x7fb6881d21a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 --2- 172.21.15.135:0/1066966411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb688139910 0x7fb6881d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 >> 172.21.15.135:0/1066966411 conn(0x7fb6880ab940 msgr2=0x7fb68809afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 shutdown_connections 2024-05-09T12:20:24.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:24.949+0000 7fb68eb93640 1 -- 172.21.15.135:0/1066966411 wait complete. 2024-05-09T12:20:24.959 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-09T12:20:23.374118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110196,"kb_used_data":1608,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377164,"statfs":{"total":386547056640,"available":386434215936,"internally_reserved":0,"allocated":1646592,"data_stored":1318124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.764776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599708+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:17.599708+0000","last_peered":"2024-05-09T12:20:17.599708+0000","last_clean":"2024-05-09T12:20:17.599708+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:17.599708+0000","last_undegraded":"2024-05-09T12:20:17.599708+0000","last_fullsized":"2024-05-09T12:20:17.599708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599615+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:17.599615+0000","last_peered":"2024-05-09T12:20:17.599615+0000","last_clean":"2024-05-09T12:20:17.599615+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:17.599615+0000","last_undegraded":"2024-05-09T12:20:17.599615+0000","last_fullsized":"2024-05-09T12:20:17.599615+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599608+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:17.599608+0000","last_peered":"2024-05-09T12:20:17.599608+0000","last_clean":"2024-05-09T12:20:17.599608+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:17.599608+0000","last_undegraded":"2024-05-09T12:20:17.599608+0000","last_fullsized":"2024-05-09T12:20:17.599608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601098+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:17.601098+0000","last_peered":"2024-05-09T12:20:17.601098+0000","last_clean":"2024-05-09T12:20:17.601098+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:17.601098+0000","last_undegraded":"2024-05-09T12:20:17.601098+0000","last_fullsized":"2024-05-09T12:20:17.601098+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":102,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599791+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:17.599791+0000","last_peered":"2024-05-09T12:20:17.599791+0000","last_clean":"2024-05-09T12:20:17.599791+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:17.599791+0000","last_undegraded":"2024-05-09T12:20:17.599791+0000","last_fullsized":"2024-05-09T12:20:17.599791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601084+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:17.601084+0000","last_peered":"2024-05-09T12:20:17.601084+0000","last_clean":"2024-05-09T12:20:17.601084+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:17.601084+0000","last_undegraded":"2024-05-09T12:20:17.601084+0000","last_fullsized":"2024-05-09T12:20:17.601084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599645+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:17.599645+0000","last_peered":"2024-05-09T12:20:17.599645+0000","last_clean":"2024-05-09T12:20:17.599645+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:17.599645+0000","last_undegraded":"2024-05-09T12:20:17.599645+0000","last_fullsized":"2024-05-09T12:20:17.599645+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599747+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:17.599747+0000","last_peered":"2024-05-09T12:20:17.599747+0000","last_clean":"2024-05-09T12:20:17.599747+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:17.599747+0000","last_undegraded":"2024-05-09T12:20:17.599747+0000","last_fullsized":"2024-05-09T12:20:17.599747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599824+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:17.599824+0000","last_peered":"2024-05-09T12:20:17.599824+0000","last_clean":"2024-05-09T12:20:17.599824+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:17.599824+0000","last_undegraded":"2024-05-09T12:20:17.599824+0000","last_fullsized":"2024-05-09T12:20:17.599824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:24.963 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:25.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.100+0000 7f5f304fc640 1 Processor -- start 2024-05-09T12:20:25.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.100+0000 7f5f304fc640 1 -- start start 2024-05-09T12:20:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f304fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 0x7f5f2813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f304fc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5f2813d370 0x7f5f28144a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f304fc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2809bfe0 con 0x7f5f28139880 2024-05-09T12:20:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f304fc640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f5f2809b3d0 con 0x7f5f2813d370 2024-05-09T12:20:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f304fc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5f280a0e30 con 0x7f5f28139c60 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2e298640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5f28139880 0x7f5f2813c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37102/0 (socket says 172.21.15.135:37102) 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2e298640 1 -- 172.21.15.135:0/753616034 learned_addr learned my addr 172.21.15.135:0/753616034 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2ea99640 1 --2- 172.21.15.135:0/753616034 >> v2:172.21.15.160:3300/0 conn(0x7f5f2813d370 0x7f5f28144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2da97640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 0x7f5f2813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2d296640 1 -- 172.21.15.135:0/753616034 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545560122 0 0) 0x7f5f2809bfe0 con 0x7f5f28139880 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2d296640 1 -- 172.21.15.135:0/753616034 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f14003520 con 0x7f5f28139880 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2ea99640 1 -- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 msgr2=0x7f5f2813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2ea99640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 0x7f5f2813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2ea99640 1 -- 172.21.15.135:0/753616034 >> v1:172.21.15.135:6789/0 conn(0x7f5f28139880 legacy=0x7f5f2813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2ea99640 1 -- 172.21.15.135:0/753616034 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2809b710 con 0x7f5f2813d370 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.101+0000 7f5f2da97640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 0x7f5f2813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.102+0000 7f5f2ea99640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f2813d370 0x7f5f28144a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009d90 tx=0x7f5f2002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced4608d76cfb60c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.102+0000 7f5f2d296640 1 -- 172.21.15.135:0/753616034 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20039070 con 0x7f5f2813d370 2024-05-09T12:20:25.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.102+0000 7f5f2d296640 1 -- 172.21.15.135:0/753616034 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2002cb30 con 0x7f5f2813d370 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.102+0000 7f5f2d296640 1 -- 172.21.15.135:0/753616034 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20034440 con 0x7f5f2813d370 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 -- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f2813d370 msgr2=0x7f5f28144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f2813d370 0x7f5f28144a90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009d90 tx=0x7f5f2002bd80 comp rx=0 tx=0).stop 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 -- 172.21.15.135:0/753616034 shutdown_connections 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f28139c60 0x7f5f2813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 --2- 172.21.15.135:0/753616034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f2813d370 0x7f5f28144a90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 -- 172.21.15.135:0/753616034 >> 172.21.15.135:0/753616034 conn(0x7f5f280aeba0 msgr2=0x7f5f280aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 -- 172.21.15.135:0/753616034 shutdown_connections 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.103+0000 7f5f304fc640 1 -- 172.21.15.135:0/753616034 wait complete. 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 Processor -- start 2024-05-09T12:20:25.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 -- start start 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f28139880 0x7f5f280a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f280a2e50 0x7f5f28136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2809c2c0 con 0x7f5f28139c60 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2809b9a0 con 0x7f5f28139880 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f304fc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2809cf10 con 0x7f5f280a2e50 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f2da97640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f2da97640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40928/0 (socket says 172.21.15.135:40928) 2024-05-09T12:20:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f2da97640 1 -- 172.21.15.135:0/3539656890 learned_addr learned my addr 172.21.15.135:0/3539656890 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f2e298640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f28139880 0x7f5f280a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.104+0000 7f5f2ea99640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f280a2e50 0x7f5f28136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 -- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f280a2e50 msgr2=0x7f5f28136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f280a2e50 0x7f5f28136300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 -- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f28139880 msgr2=0x7f5f280a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f28139880 0x7f5f280a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 -- 172.21.15.135:0/3539656890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f280a44e0 con 0x7f5f28139c60 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f2da97640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800ebe0 tx=0x7f5f1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18017070 con 0x7f5f28139c60 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1800cc30 con 0x7f5f28139c60 2024-05-09T12:20:25.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f280a5650 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18013470 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.105+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f280a5bf0 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.106+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f280508d0 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.107+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5f1801a070 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.107+0000 7f5f1effd640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 0x7f5f0c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.107+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f5f18096e10 con 0x7f5f28139c60 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.107+0000 7f5f2e298640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 0x7f5f0c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.108+0000 7f5f2e298640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 0x7f5f0c0787c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005880 tx=0x7f5f24006aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.112+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f18060710 con 0x7f5f28139c60 2024-05-09T12:20:25.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.288+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f280a3620 con 0x7f5f0c076300 2024-05-09T12:20:25.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.293+0000 7f5f1effd640 1 -- 172.21.15.135:0/3539656890 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255593 (secure 0 0 0) 0x7f5f24001370 con 0x7f5f0c076300 2024-05-09T12:20:25.294 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:25.298 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:25.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 msgr2=0x7f5f0c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 0x7f5f0c0787c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f24005880 tx=0x7f5f24006aa0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 msgr2=0x7f5f280a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800ebe0 tx=0x7f5f1800c520 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 shutdown_connections 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5f0c076300 0x7f5f0c0787c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f280a2e50 0x7f5f28136300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f28139c60 0x7f5f280a2910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 --2- 172.21.15.135:0/3539656890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f28139880 0x7f5f280a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 >> 172.21.15.135:0/3539656890 conn(0x7f5f280aeba0 msgr2=0x7f5f2813a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 shutdown_connections 2024-05-09T12:20:25.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.296+0000 7f5f304fc640 1 -- 172.21.15.135:0/3539656890 wait complete. 2024-05-09T12:20:25.307 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-09T12:20:23.374118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110196,"kb_used_data":1608,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377164,"statfs":{"total":386547056640,"available":386434215936,"internally_reserved":0,"allocated":1646592,"data_stored":1318124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.764776"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599708+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:17.599708+0000","last_peered":"2024-05-09T12:20:17.599708+0000","last_clean":"2024-05-09T12:20:17.599708+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:17.599708+0000","last_undegraded":"2024-05-09T12:20:17.599708+0000","last_fullsized":"2024-05-09T12:20:17.599708+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599615+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:17.599615+0000","last_peered":"2024-05-09T12:20:17.599615+0000","last_clean":"2024-05-09T12:20:17.599615+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:17.599615+0000","last_undegraded":"2024-05-09T12:20:17.599615+0000","last_fullsized":"2024-05-09T12:20:17.599615+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599608+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:17.599608+0000","last_peered":"2024-05-09T12:20:17.599608+0000","last_clean":"2024-05-09T12:20:17.599608+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:17.599608+0000","last_undegraded":"2024-05-09T12:20:17.599608+0000","last_fullsized":"2024-05-09T12:20:17.599608+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601098+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:17.601098+0000","last_peered":"2024-05-09T12:20:17.601098+0000","last_clean":"2024-05-09T12:20:17.601098+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:17.601098+0000","last_undegraded":"2024-05-09T12:20:17.601098+0000","last_fullsized":"2024-05-09T12:20:17.601098+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":102,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599791+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:17.599791+0000","last_peered":"2024-05-09T12:20:17.599791+0000","last_clean":"2024-05-09T12:20:17.599791+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:17.599791+0000","last_undegraded":"2024-05-09T12:20:17.599791+0000","last_fullsized":"2024-05-09T12:20:17.599791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.601084+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:17.601084+0000","last_peered":"2024-05-09T12:20:17.601084+0000","last_clean":"2024-05-09T12:20:17.601084+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:17.601084+0000","last_undegraded":"2024-05-09T12:20:17.601084+0000","last_fullsized":"2024-05-09T12:20:17.601084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599645+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:17.599645+0000","last_peered":"2024-05-09T12:20:17.599645+0000","last_clean":"2024-05-09T12:20:17.599645+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:17.599645+0000","last_undegraded":"2024-05-09T12:20:17.599645+0000","last_fullsized":"2024-05-09T12:20:17.599645+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599747+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:17.599747+0000","last_peered":"2024-05-09T12:20:17.599747+0000","last_clean":"2024-05-09T12:20:17.599747+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:17.599747+0000","last_undegraded":"2024-05-09T12:20:17.599747+0000","last_fullsized":"2024-05-09T12:20:17.599747+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-09T12:20:17.599824+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:17.599824+0000","last_peered":"2024-05-09T12:20:17.599824+0000","last_clean":"2024-05-09T12:20:17.599824+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:17.599824+0000","last_undegraded":"2024-05-09T12:20:17.599824+0000","last_fullsized":"2024-05-09T12:20:17.599824+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:20.607024+0000","last_change":"2024-05-09T12:20:20.607024+0000","last_active":"2024-05-09T12:20:20.607024+0000","last_peered":"2024-05-09T12:20:20.607024+0000","last_clean":"2024-05-09T12:20:20.607024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:20.607024+0000","last_undegraded":"2024-05-09T12:20:20.607024+0000","last_fullsized":"2024-05-09T12:20:20.607024+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T12:20:19.598551+0000","last_change":"2024-05-09T12:20:19.598551+0000","last_active":"2024-05-09T12:20:19.598551+0000","last_peered":"2024-05-09T12:20:19.598551+0000","last_clean":"2024-05-09T12:20:19.598551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T12:20:19.598551+0000","last_undegraded":"2024-05-09T12:20:19.598551+0000","last_fullsized":"2024-05-09T12:20:19.598551+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":708608,"data_stored":624715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":114688,"data_stored":34347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-05-09T12:20:25.311 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-05-09T12:20:25.312 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-05-09T12:20:25.313 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-05-09T12:20:25.314 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.315 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-05-09T12:20:25.316 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-05-09T12:20:25.317 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.318 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.319 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-05-09T12:20:25.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.321 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-05-09T12:20:25.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-05-09T12:20:25.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-05-09T12:20:25.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.325 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.326 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-05-09T12:20:25.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-05-09T12:20:25.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-05-09T12:20:25.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:20.607024+0000', 'last_change': '2024-05-09T12:20:20.607024+0000', 'last_active': '2024-05-09T12:20:20.607024+0000', 'last_peered': '2024-05-09T12:20:20.607024+0000', 'last_clean': '2024-05-09T12:20:20.607024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:20.607024+0000', 'last_undegraded': '2024-05-09T12:20:20.607024+0000', 'last_fullsized': '2024-05-09T12:20:20.607024+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:20.607024+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-05-09T12:20:25.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-09T12:20:19.598551+0000', 'last_change': '2024-05-09T12:20:19.598551+0000', 'last_active': '2024-05-09T12:20:19.598551+0000', 'last_peered': '2024-05-09T12:20:19.598551+0000', 'last_clean': '2024-05-09T12:20:19.598551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-09T12:20:19.598551+0000', 'last_undegraded': '2024-05-09T12:20:19.598551+0000', 'last_fullsized': '2024-05-09T12:20:19.598551+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'last_clean_scrub_stamp': '2024-05-09T12:20:19.598551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-09T12:20:25.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-09T12:20:25.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.446+0000 7faeac9bf640 1 Processor -- start 2024-05-09T12:20:25.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.446+0000 7faeac9bf640 1 -- start start 2024-05-09T12:20:25.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faeac9bf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faea813bd00 0x7faea813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faeac9bf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 0x7faea8144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faeac9bf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea80a2060 con 0x7faea80a69c0 2024-05-09T12:20:25.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faeac9bf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7faea80a7680 con 0x7faea813bd00 2024-05-09T12:20:25.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faeac9bf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faea80a3520 con 0x7faea80a6030 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faea813bd00 0x7faea813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea5d9b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faea80a69c0 0x7faea80a5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37106/0 (socket says 172.21.15.135:37106) 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea5d9b640 1 -- 172.21.15.135:0/1637851815 learned_addr learned my addr 172.21.15.135:0/1637851815 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea6d9d640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 0x7faea8144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea659c640 1 -- 172.21.15.135:0/1637851815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 msgr2=0x7faea8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea659c640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 0x7faea8144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea659c640 1 -- 172.21.15.135:0/1637851815 >> v1:172.21.15.135:6789/0 conn(0x7faea80a69c0 legacy=0x7faea80a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea659c640 1 -- 172.21.15.135:0/1637851815 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea80a4e30 con 0x7faea813bd00 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea559a640 1 -- 172.21.15.135:0/1637851815 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017872849 0 0) 0x7faea80a2060 con 0x7faea80a69c0 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.447+0000 7faea6d9d640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 0x7faea8144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.448+0000 7faea659c640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea813bd00 0x7faea813c0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faea0009d90 tx=0x7faea002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d7f3735002f29f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.448+0000 7faea559a640 1 -- 172.21.15.135:0/1637851815 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0039070 con 0x7faea813bd00 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.448+0000 7faea559a640 1 -- 172.21.15.135:0/1637851815 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea002cbc0 con 0x7faea813bd00 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.448+0000 7faea559a640 1 -- 172.21.15.135:0/1637851815 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0034440 con 0x7faea813bd00 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 -- 172.21.15.135:0/1637851815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea813bd00 msgr2=0x7faea813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea813bd00 0x7faea813c0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faea0009d90 tx=0x7faea002be10 comp rx=0 tx=0).stop 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 -- 172.21.15.135:0/1637851815 shutdown_connections 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a6030 0x7faea8144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 --2- 172.21.15.135:0/1637851815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea813bd00 0x7faea813c0e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 -- 172.21.15.135:0/1637851815 >> 172.21.15.135:0/1637851815 conn(0x7faea80aaf20 msgr2=0x7faea80ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 -- 172.21.15.135:0/1637851815 shutdown_connections 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.449+0000 7faeac9bf640 1 -- 172.21.15.135:0/1637851815 wait complete. 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.450+0000 7faeac9bf640 1 Processor -- start 2024-05-09T12:20:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.450+0000 7faeac9bf640 1 -- start start 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faea813bd00 0x7faea809e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a0d50 0x7faea809eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faea80a50f0 con 0x7faea80a6030 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faea80a37e0 con 0x7faea813bd00 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faea8075510 con 0x7faea80a0d50 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40952/0 (socket says 172.21.15.135:40952) 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 -- 172.21.15.135:0/2058975764 learned_addr learned my addr 172.21.15.135:0/2058975764 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 -- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a0d50 msgr2=0x7faea809eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a0d50 0x7faea809eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 -- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faea813bd00 msgr2=0x7faea809e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faea813bd00 0x7faea809e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 -- 172.21.15.135:0/2058975764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea8121810 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faea659c640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faea0037040 tx=0x7faea0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0039050 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea0045070 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea8121ab0 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea003ea50 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.451+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea8122270 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.452+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea8069e10 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.453+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faea002ca40 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.453+0000 7fae9effd640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 0x7fae88078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.453+0000 7faea5d9b640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 0x7fae88078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.453+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7faea00b9e80 con 0x7faea80a6030 2024-05-09T12:20:25.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.454+0000 7faea5d9b640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 0x7fae88078790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faea809f910 tx=0x7fae900078d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.458+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faea0083780 con 0x7faea80a6030 2024-05-09T12:20:25.683 INFO:tasks.ceph.mds.a.smithi135.stderr:2024-05-09T12:20:25.684+0000 7fa3fbf15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T12:20:25.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.714+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faea809bfe0 con 0x7faea80a6030 2024-05-09T12:20:25.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.714+0000 7fae9effd640 1 -- 172.21.15.135:0/2058975764 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7faea0087a80 con 0x7faea80a6030 2024-05-09T12:20:25.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:25.714 INFO:teuthology.orchestra.run.smithi135.stdout:{"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1715257213,"num_in_osds":4,"osd_in_since":1715257206,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592778,"bytes_used":112590848,"bytes_avail":386434465792,"bytes_total":386547056640,"write_bytes_sec":2486,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4215}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-09T12:20:05.066097+0000","services":{}},"progress_events":{}} 2024-05-09T12:20:25.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.716+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 msgr2=0x7fae88078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.716+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 0x7fae88078790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faea809f910 tx=0x7fae900078d0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.716+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 msgr2=0x7faea809e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.716+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faea0037040 tx=0x7faea0004a40 comp rx=0 tx=0).stop 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 shutdown_connections 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fae880762d0 0x7fae88078790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faea80a0d50 0x7faea809eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faea813bd00 0x7faea809e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 --2- 172.21.15.135:0/2058975764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faea80a6030 0x7faea809e0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 >> 172.21.15.135:0/2058975764 conn(0x7faea80aaf20 msgr2=0x7faea813add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 shutdown_connections 2024-05-09T12:20:25.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.717+0000 7faeac9bf640 1 -- 172.21.15.135:0/2058975764 wait complete. 2024-05-09T12:20:25.727 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-09T12:20:25.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.826+0000 7f4b93d5b640 1 Processor -- start 2024-05-09T12:20:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b93d5b640 1 -- start start 2024-05-09T12:20:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b93d5b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b8c1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b93d5b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8c09c7c0 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b93d5b640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8c09caa0 con 0x7f4b8c09e340 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b93d5b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c074150 con 0x7f4b8c141400 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b912f6640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4b8c13d8f0 0x7f4b8c13fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37118/0 (socket says 172.21.15.135:37118) 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b912f6640 1 -- 172.21.15.135:0/228396308 learned_addr learned my addr 172.21.15.135:0/228396308 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b922f8640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b8c1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.827+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009771289 0 0) 0x7f4b8c09c7c0 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b74003520 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553172110 0 0) 0x7f4b74003520 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 msgr2=0x7f4b8c1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b8c1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 >> v1:172.21.15.160:6789/0 conn(0x7f4b8c09e340 legacy=0x7f4b8c09e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c09d680 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f4b800016f0 con 0x7f4b8c13d8f0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 >> v1:172.21.15.135:6789/0 conn(0x7f4b8c13d8f0 legacy=0x7f4b8c13fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b740039e0 0x7f4b74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b74004d40 0x7f4b740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c074150 con 0x7f4b74004d40 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7400bba0 con 0x7f4b740039e0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7400bda0 con 0x7f4b8c141400 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b74004d40 0x7f4b740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b91af7640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b740039e0 0x7f4b74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b912f6640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 -- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 msgr2=0x7f4b74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c141400 0x7f4b74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 -- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b740039e0 msgr2=0x7f4b74003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b740039e0 0x7f4b74003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.828+0000 7f4b922f8640 1 -- 172.21.15.135:0/228396308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b74003520 con 0x7f4b74004d40 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b922f8640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b74004d40 0x7f4b740051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009f90 tx=0x7f4b74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe82f40a14fc052 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c039070 con 0x7f4b74004d40 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c02cbd0 con 0x7f4b74004d40 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b90af5640 1 -- 172.21.15.135:0/228396308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c009c10 con 0x7f4b74004d40 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b93d5b640 1 -- 172.21.15.135:0/228396308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b74004d40 msgr2=0x7f4b740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/228396308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b74004d40 0x7f4b740051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009f90 tx=0x7f4b74005830 comp rx=0 tx=0).stop 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.829+0000 7f4b922f8640 1 -- 172.21.15.135:0/228396308 reap_dead start 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.830+0000 7f4b93d5b640 1 -- 172.21.15.135:0/228396308 shutdown_connections 2024-05-09T12:20:25.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.830+0000 7f4b93d5b640 1 -- 172.21.15.135:0/228396308 >> 172.21.15.135:0/228396308 conn(0x7f4b8c0acb30 msgr2=0x7f4b8c0acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.830+0000 7f4b93d5b640 1 -- 172.21.15.135:0/228396308 shutdown_connections 2024-05-09T12:20:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.830+0000 7f4b93d5b640 1 -- 172.21.15.135:0/228396308 wait complete. 2024-05-09T12:20:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.830+0000 7f4b93d5b640 1 Processor -- start 2024-05-09T12:20:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 -- start start 2024-05-09T12:20:25.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b74004d40 0x7f4b8c0a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c0a0630 0x7f4b8c0a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c09c500 con 0x7f4b8c1350c0 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c09c230 con 0x7f4b74004d40 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b93d5b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c09b520 con 0x7f4b8c0a0630 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40960/0 (socket says 172.21.15.135:40960) 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 -- 172.21.15.135:0/250116215 learned_addr learned my addr 172.21.15.135:0/250116215 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b91af7640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b74004d40 0x7f4b8c0a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b912f6640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c0a0630 0x7f4b8c0a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 -- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c0a0630 msgr2=0x7f4b8c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c0a0630 0x7f4b8c0a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 -- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b74004d40 msgr2=0x7f4b8c0a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:25.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b74004d40 0x7f4b8c0a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.831+0000 7f4b922f8640 1 -- 172.21.15.135:0/250116215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c069a50 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b922f8640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00e230 tx=0x7f4b7c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c039070 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7c03a040 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c09e110 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c003bd0 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.832+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c0a2700 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.833+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8c0508d0 con 0x7f4b8c1350c0 2024-05-09T12:20:25.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.833+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4b7c004030 con 0x7f4b8c1350c0 2024-05-09T12:20:25.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.834+0000 7f4b8a7fc640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 0x7f4b78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:25.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.834+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f4b7c0b93a0 con 0x7f4b8c1350c0 2024-05-09T12:20:25.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.834+0000 7f4b91af7640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 0x7f4b78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:25.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.834+0000 7f4b91af7640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 0x7f4b78078790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b84007fd0 tx=0x7f4b84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:25.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:25.838+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4b7c082ca0 con 0x7f4b8c1350c0 2024-05-09T12:20:26.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.019+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b8c09bf70 con 0x7f4b780762d0 2024-05-09T12:20:26.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.026+0000 7f4b8a7fc640 1 -- 172.21.15.135:0/250116215 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268589 (secure 0 0 0) 0x7f4b8c09bf70 con 0x7f4b780762d0 2024-05-09T12:20:26.028 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:26.029 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 msgr2=0x7f4b78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 0x7f4b78078790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b84007fd0 tx=0x7f4b84009040 comp rx=0 tx=0).stop 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 msgr2=0x7f4b8c135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00e230 tx=0x7f4b7c009750 comp rx=0 tx=0).stop 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 shutdown_connections 2024-05-09T12:20:26.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4b780762d0 0x7f4b78078790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b8c1350c0 0x7f4b8c135540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b8c0a0630 0x7f4b8c0a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 --2- 172.21.15.135:0/250116215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b74004d40 0x7f4b8c0a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 >> 172.21.15.135:0/250116215 conn(0x7f4b8c0acb30 msgr2=0x7f4b8c0aa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 shutdown_connections 2024-05-09T12:20:26.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:26.029+0000 7f4b93d5b640 1 -- 172.21.15.135:0/250116215 wait complete. 2024-05-09T12:20:26.040 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-09T12:20:25.374464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109952,"kb_used_data":1848,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377408,"statfs":{"total":386547056640,"available":386434465792,"internally_reserved":0,"allocated":1892352,"data_stored":1401356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.765122"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961005+0000","last_change":"2024-05-09T12:20:21.640078+0000","last_active":"2024-05-09T12:20:22.961005+0000","last_peered":"2024-05-09T12:20:22.961005+0000","last_clean":"2024-05-09T12:20:22.961005+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:20:22.961005+0000","last_undegraded":"2024-05-09T12:20:22.961005+0000","last_fullsized":"2024-05-09T12:20:22.961005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633805+0000","last_change":"2024-05-09T12:20:21.640588+0000","last_active":"2024-05-09T12:20:22.633805+0000","last_peered":"2024-05-09T12:20:22.633805+0000","last_clean":"2024-05-09T12:20:22.633805+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:20:22.633805+0000","last_undegraded":"2024-05-09T12:20:22.633805+0000","last_fullsized":"2024-05-09T12:20:22.633805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633146+0000","last_change":"2024-05-09T12:20:21.639557+0000","last_active":"2024-05-09T12:20:22.633146+0000","last_peered":"2024-05-09T12:20:22.633146+0000","last_clean":"2024-05-09T12:20:22.633146+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:20:22.633146+0000","last_undegraded":"2024-05-09T12:20:22.633146+0000","last_fullsized":"2024-05-09T12:20:22.633146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:37.437914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632341+0000","last_change":"2024-05-09T12:20:21.641474+0000","last_active":"2024-05-09T12:20:22.632341+0000","last_peered":"2024-05-09T12:20:22.632341+0000","last_clean":"2024-05-09T12:20:22.632341+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:20:22.632341+0000","last_undegraded":"2024-05-09T12:20:22.632341+0000","last_fullsized":"2024-05-09T12:20:22.632341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960955+0000","last_change":"2024-05-09T12:20:21.641137+0000","last_active":"2024-05-09T12:20:22.960955+0000","last_peered":"2024-05-09T12:20:22.960955+0000","last_clean":"2024-05-09T12:20:22.960955+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:20:22.960955+0000","last_undegraded":"2024-05-09T12:20:22.960955+0000","last_fullsized":"2024-05-09T12:20:22.960955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631841+0000","last_change":"2024-05-09T12:20:21.637744+0000","last_active":"2024-05-09T12:20:22.631841+0000","last_peered":"2024-05-09T12:20:22.631841+0000","last_clean":"2024-05-09T12:20:22.631841+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:20:22.631841+0000","last_undegraded":"2024-05-09T12:20:22.631841+0000","last_fullsized":"2024-05-09T12:20:22.631841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632362+0000","last_change":"2024-05-09T12:20:21.641996+0000","last_active":"2024-05-09T12:20:22.632362+0000","last_peered":"2024-05-09T12:20:22.632362+0000","last_clean":"2024-05-09T12:20:22.632362+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:20:22.632362+0000","last_undegraded":"2024-05-09T12:20:22.632362+0000","last_fullsized":"2024-05-09T12:20:22.632362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632430+0000","last_change":"2024-05-09T12:20:21.637546+0000","last_active":"2024-05-09T12:20:22.632430+0000","last_peered":"2024-05-09T12:20:22.632430+0000","last_clean":"2024-05-09T12:20:22.632430+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:20:22.632430+0000","last_undegraded":"2024-05-09T12:20:22.632430+0000","last_fullsized":"2024-05-09T12:20:22.632430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960747+0000","last_change":"2024-05-09T12:20:21.640522+0000","last_active":"2024-05-09T12:20:22.960747+0000","last_peered":"2024-05-09T12:20:22.960747+0000","last_clean":"2024-05-09T12:20:22.960747+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:20:22.960747+0000","last_undegraded":"2024-05-09T12:20:22.960747+0000","last_fullsized":"2024-05-09T12:20:22.960747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632891+0000","last_change":"2024-05-09T12:20:21.642468+0000","last_active":"2024-05-09T12:20:22.632891+0000","last_peered":"2024-05-09T12:20:22.632891+0000","last_clean":"2024-05-09T12:20:22.632891+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:20:22.632891+0000","last_undegraded":"2024-05-09T12:20:22.632891+0000","last_fullsized":"2024-05-09T12:20:22.632891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633090+0000","last_change":"2024-05-09T12:20:21.634590+0000","last_active":"2024-05-09T12:20:22.633090+0000","last_peered":"2024-05-09T12:20:22.633090+0000","last_clean":"2024-05-09T12:20:22.633090+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:20:22.633090+0000","last_undegraded":"2024-05-09T12:20:22.633090+0000","last_fullsized":"2024-05-09T12:20:22.633090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631426+0000","last_change":"2024-05-09T12:20:21.630566+0000","last_active":"2024-05-09T12:20:22.631426+0000","last_peered":"2024-05-09T12:20:22.631426+0000","last_clean":"2024-05-09T12:20:22.631426+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:20:22.631426+0000","last_undegraded":"2024-05-09T12:20:22.631426+0000","last_fullsized":"2024-05-09T12:20:22.631426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960373+0000","last_change":"2024-05-09T12:20:21.642290+0000","last_active":"2024-05-09T12:20:22.960373+0000","last_peered":"2024-05-09T12:20:22.960373+0000","last_clean":"2024-05-09T12:20:22.960373+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:20:22.960373+0000","last_undegraded":"2024-05-09T12:20:22.960373+0000","last_fullsized":"2024-05-09T12:20:22.960373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631972+0000","last_change":"2024-05-09T12:20:21.636007+0000","last_active":"2024-05-09T12:20:22.631972+0000","last_peered":"2024-05-09T12:20:22.631972+0000","last_clean":"2024-05-09T12:20:22.631972+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:20:22.631972+0000","last_undegraded":"2024-05-09T12:20:22.631972+0000","last_fullsized":"2024-05-09T12:20:22.631972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632535+0000","last_change":"2024-05-09T12:20:21.640762+0000","last_active":"2024-05-09T12:20:22.632535+0000","last_peered":"2024-05-09T12:20:22.632535+0000","last_clean":"2024-05-09T12:20:22.632535+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:20:22.632535+0000","last_undegraded":"2024-05-09T12:20:22.632535+0000","last_fullsized":"2024-05-09T12:20:22.632535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633618+0000","last_change":"2024-05-09T12:20:21.635550+0000","last_active":"2024-05-09T12:20:22.633618+0000","last_peered":"2024-05-09T12:20:22.633618+0000","last_clean":"2024-05-09T12:20:22.633618+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:20:22.633618+0000","last_undegraded":"2024-05-09T12:20:22.633618+0000","last_fullsized":"2024-05-09T12:20:22.633618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:13:25.977279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960675+0000","last_change":"2024-05-09T12:20:21.640922+0000","last_active":"2024-05-09T12:20:22.960675+0000","last_peered":"2024-05-09T12:20:22.960675+0000","last_clean":"2024-05-09T12:20:22.960675+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:20:22.960675+0000","last_undegraded":"2024-05-09T12:20:22.960675+0000","last_fullsized":"2024-05-09T12:20:22.960675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633064+0000","last_change":"2024-05-09T12:20:21.639291+0000","last_active":"2024-05-09T12:20:22.633064+0000","last_peered":"2024-05-09T12:20:22.633064+0000","last_clean":"2024-05-09T12:20:22.633064+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:20:22.633064+0000","last_undegraded":"2024-05-09T12:20:22.633064+0000","last_fullsized":"2024-05-09T12:20:22.633064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:57.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960841+0000","last_change":"2024-05-09T12:20:21.636709+0000","last_active":"2024-05-09T12:20:22.960841+0000","last_peered":"2024-05-09T12:20:22.960841+0000","last_clean":"2024-05-09T12:20:22.960841+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:20:22.960841+0000","last_undegraded":"2024-05-09T12:20:22.960841+0000","last_fullsized":"2024-05-09T12:20:22.960841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632942+0000","last_change":"2024-05-09T12:20:21.637072+0000","last_active":"2024-05-09T12:20:22.632942+0000","last_peered":"2024-05-09T12:20:22.632942+0000","last_clean":"2024-05-09T12:20:22.632942+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:20:22.632942+0000","last_undegraded":"2024-05-09T12:20:22.632942+0000","last_fullsized":"2024-05-09T12:20:22.632942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632736+0000","last_change":"2024-05-09T12:20:21.638705+0000","last_active":"2024-05-09T12:20:22.632736+0000","last_peered":"2024-05-09T12:20:22.632736+0000","last_clean":"2024-05-09T12:20:22.632736+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:20:22.632736+0000","last_undegraded":"2024-05-09T12:20:22.632736+0000","last_fullsized":"2024-05-09T12:20:22.632736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960312+0000","last_change":"2024-05-09T12:20:21.634342+0000","last_active":"2024-05-09T12:20:22.960312+0000","last_peered":"2024-05-09T12:20:22.960312+0000","last_clean":"2024-05-09T12:20:22.960312+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:20:22.960312+0000","last_undegraded":"2024-05-09T12:20:22.960312+0000","last_fullsized":"2024-05-09T12:20:22.960312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631183+0000","last_change":"2024-05-09T12:20:21.637932+0000","last_active":"2024-05-09T12:20:22.631183+0000","last_peered":"2024-05-09T12:20:22.631183+0000","last_clean":"2024-05-09T12:20:22.631183+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:20:22.631183+0000","last_undegraded":"2024-05-09T12:20:22.631183+0000","last_fullsized":"2024-05-09T12:20:22.631183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632621+0000","last_change":"2024-05-09T12:20:21.637783+0000","last_active":"2024-05-09T12:20:22.632621+0000","last_peered":"2024-05-09T12:20:22.632621+0000","last_clean":"2024-05-09T12:20:22.632621+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:20:22.632621+0000","last_undegraded":"2024-05-09T12:20:22.632621+0000","last_fullsized":"2024-05-09T12:20:22.632621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631842+0000","last_change":"2024-05-09T12:20:21.631135+0000","last_active":"2024-05-09T12:20:22.631842+0000","last_peered":"2024-05-09T12:20:22.631842+0000","last_clean":"2024-05-09T12:20:22.631842+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:20:22.631842+0000","last_undegraded":"2024-05-09T12:20:22.631842+0000","last_fullsized":"2024-05-09T12:20:22.631842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631710+0000","last_change":"2024-05-09T12:20:21.634947+0000","last_active":"2024-05-09T12:20:22.631710+0000","last_peered":"2024-05-09T12:20:22.631710+0000","last_clean":"2024-05-09T12:20:22.631710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:20:22.631710+0000","last_undegraded":"2024-05-09T12:20:22.631710+0000","last_fullsized":"2024-05-09T12:20:22.631710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633466+0000","last_change":"2024-05-09T12:20:21.639631+0000","last_active":"2024-05-09T12:20:22.633466+0000","last_peered":"2024-05-09T12:20:22.633466+0000","last_clean":"2024-05-09T12:20:22.633466+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:20:22.633466+0000","last_undegraded":"2024-05-09T12:20:22.633466+0000","last_fullsized":"2024-05-09T12:20:22.633466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:22.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:21.644243+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960667+0000","last_change":"2024-05-09T12:20:21.641857+0000","last_active":"2024-05-09T12:20:22.960667+0000","last_peered":"2024-05-09T12:20:22.960667+0000","last_clean":"2024-05-09T12:20:22.960667+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:20:22.960667+0000","last_undegraded":"2024-05-09T12:20:22.960667+0000","last_fullsized":"2024-05-09T12:20:22.960667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631990+0000","last_change":"2024-05-09T12:20:21.638340+0000","last_active":"2024-05-09T12:20:22.631990+0000","last_peered":"2024-05-09T12:20:22.631990+0000","last_clean":"2024-05-09T12:20:22.631990+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:20:22.631990+0000","last_undegraded":"2024-05-09T12:20:22.631990+0000","last_fullsized":"2024-05-09T12:20:22.631990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631085+0000","last_change":"2024-05-09T12:20:21.634751+0000","last_active":"2024-05-09T12:20:22.631085+0000","last_peered":"2024-05-09T12:20:22.631085+0000","last_clean":"2024-05-09T12:20:22.631085+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:20:22.631085+0000","last_undegraded":"2024-05-09T12:20:22.631085+0000","last_fullsized":"2024-05-09T12:20:22.631085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631736+0000","last_change":"2024-05-09T12:20:21.636322+0000","last_active":"2024-05-09T12:20:22.631736+0000","last_peered":"2024-05-09T12:20:22.631736+0000","last_clean":"2024-05-09T12:20:22.631736+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:20:22.631736+0000","last_undegraded":"2024-05-09T12:20:22.631736+0000","last_fullsized":"2024-05-09T12:20:22.631736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:01.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632003+0000","last_change":"2024-05-09T12:20:21.644274+0000","last_active":"2024-05-09T12:20:22.632003+0000","last_peered":"2024-05-09T12:20:22.632003+0000","last_clean":"2024-05-09T12:20:22.632003+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:20:22.632003+0000","last_undegraded":"2024-05-09T12:20:22.632003+0000","last_fullsized":"2024-05-09T12:20:22.632003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632909+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:20:22.632909+0000","last_peered":"2024-05-09T12:20:22.632909+0000","last_clean":"2024-05-09T12:20:22.632909+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:20:22.632909+0000","last_undegraded":"2024-05-09T12:20:22.632909+0000","last_fullsized":"2024-05-09T12:20:22.632909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633947+0000","last_change":"2024-05-09T12:20:21.644211+0000","last_active":"2024-05-09T12:20:22.633947+0000","last_peered":"2024-05-09T12:20:22.633947+0000","last_clean":"2024-05-09T12:20:22.633947+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:20:22.633947+0000","last_undegraded":"2024-05-09T12:20:22.633947+0000","last_fullsized":"2024-05-09T12:20:22.633947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:14:09.661175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960243+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:20:22.960243+0000","last_peered":"2024-05-09T12:20:22.960243+0000","last_clean":"2024-05-09T12:20:22.960243+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:20:22.960243+0000","last_undegraded":"2024-05-09T12:20:22.960243+0000","last_fullsized":"2024-05-09T12:20:22.960243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960788+0000","last_change":"2024-05-09T12:20:21.636434+0000","last_active":"2024-05-09T12:20:22.960788+0000","last_peered":"2024-05-09T12:20:22.960788+0000","last_clean":"2024-05-09T12:20:22.960788+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:20:22.960788+0000","last_undegraded":"2024-05-09T12:20:22.960788+0000","last_fullsized":"2024-05-09T12:20:22.960788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633456+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:20:22.633456+0000","last_peered":"2024-05-09T12:20:22.633456+0000","last_clean":"2024-05-09T12:20:22.633456+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:20:22.633456+0000","last_undegraded":"2024-05-09T12:20:22.633456+0000","last_fullsized":"2024-05-09T12:20:22.633456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960804+0000","last_change":"2024-05-09T12:20:21.639841+0000","last_active":"2024-05-09T12:20:22.960804+0000","last_peered":"2024-05-09T12:20:22.960804+0000","last_clean":"2024-05-09T12:20:22.960804+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:20:22.960804+0000","last_undegraded":"2024-05-09T12:20:22.960804+0000","last_fullsized":"2024-05-09T12:20:22.960804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633556+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:20:22.633556+0000","last_peered":"2024-05-09T12:20:22.633556+0000","last_clean":"2024-05-09T12:20:22.633556+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:20:22.633556+0000","last_undegraded":"2024-05-09T12:20:22.633556+0000","last_fullsized":"2024-05-09T12:20:22.633556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633459+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:20:22.633459+0000","last_peered":"2024-05-09T12:20:22.633459+0000","last_clean":"2024-05-09T12:20:22.633459+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:20:22.633459+0000","last_undegraded":"2024-05-09T12:20:22.633459+0000","last_fullsized":"2024-05-09T12:20:22.633459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633360+0000","last_change":"2024-05-09T12:20:21.637705+0000","last_active":"2024-05-09T12:20:22.633360+0000","last_peered":"2024-05-09T12:20:22.633360+0000","last_clean":"2024-05-09T12:20:22.633360+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:20:22.633360+0000","last_undegraded":"2024-05-09T12:20:22.633360+0000","last_fullsized":"2024-05-09T12:20:22.633360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.118933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633827+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:20:22.633827+0000","last_peered":"2024-05-09T12:20:22.633827+0000","last_clean":"2024-05-09T12:20:22.633827+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:20:22.633827+0000","last_undegraded":"2024-05-09T12:20:22.633827+0000","last_fullsized":"2024-05-09T12:20:22.633827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632728+0000","last_change":"2024-05-09T12:20:21.641492+0000","last_active":"2024-05-09T12:20:22.632728+0000","last_peered":"2024-05-09T12:20:22.632728+0000","last_clean":"2024-05-09T12:20:22.632728+0000","last_became_active":"2024-05-09T12:20:21.640732+0000","last_became_peered":"2024-05-09T12:20:21.640732+0000","last_unstale":"2024-05-09T12:20:22.632728+0000","last_undegraded":"2024-05-09T12:20:22.632728+0000","last_fullsized":"2024-05-09T12:20:22.632728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633937+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:20:22.633937+0000","last_peered":"2024-05-09T12:20:22.633937+0000","last_clean":"2024-05-09T12:20:22.633937+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:20:22.633937+0000","last_undegraded":"2024-05-09T12:20:22.633937+0000","last_fullsized":"2024-05-09T12:20:22.633937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633355+0000","last_change":"2024-05-09T12:20:21.631032+0000","last_active":"2024-05-09T12:20:22.633355+0000","last_peered":"2024-05-09T12:20:22.633355+0000","last_clean":"2024-05-09T12:20:22.633355+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:20:22.633355+0000","last_undegraded":"2024-05-09T12:20:22.633355+0000","last_fullsized":"2024-05-09T12:20:22.633355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633192+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:20:22.633192+0000","last_peered":"2024-05-09T12:20:22.633192+0000","last_clean":"2024-05-09T12:20:22.633192+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:20:22.633192+0000","last_undegraded":"2024-05-09T12:20:22.633192+0000","last_fullsized":"2024-05-09T12:20:22.633192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960799+0000","last_change":"2024-05-09T12:20:21.641618+0000","last_active":"2024-05-09T12:20:22.960799+0000","last_peered":"2024-05-09T12:20:22.960799+0000","last_clean":"2024-05-09T12:20:22.960799+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:20:22.960799+0000","last_undegraded":"2024-05-09T12:20:22.960799+0000","last_fullsized":"2024-05-09T12:20:22.960799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631757+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:20:22.631757+0000","last_peered":"2024-05-09T12:20:22.631757+0000","last_clean":"2024-05-09T12:20:22.631757+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:20:22.631757+0000","last_undegraded":"2024-05-09T12:20:22.631757+0000","last_fullsized":"2024-05-09T12:20:22.631757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633261+0000","last_change":"2024-05-09T12:20:21.639712+0000","last_active":"2024-05-09T12:20:22.633261+0000","last_peered":"2024-05-09T12:20:22.633261+0000","last_clean":"2024-05-09T12:20:22.633261+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:20:22.633261+0000","last_undegraded":"2024-05-09T12:20:22.633261+0000","last_fullsized":"2024-05-09T12:20:22.633261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:55.515277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632264+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:20:22.632264+0000","last_peered":"2024-05-09T12:20:22.632264+0000","last_clean":"2024-05-09T12:20:22.632264+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:20:22.632264+0000","last_undegraded":"2024-05-09T12:20:22.632264+0000","last_fullsized":"2024-05-09T12:20:22.632264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633552+0000","last_change":"2024-05-09T12:20:21.643678+0000","last_active":"2024-05-09T12:20:22.633552+0000","last_peered":"2024-05-09T12:20:22.633552+0000","last_clean":"2024-05-09T12:20:22.633552+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:20:22.633552+0000","last_undegraded":"2024-05-09T12:20:22.633552+0000","last_fullsized":"2024-05-09T12:20:22.633552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:13.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632484+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:20:22.632484+0000","last_peered":"2024-05-09T12:20:22.632484+0000","last_clean":"2024-05-09T12:20:22.632484+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:20:22.632484+0000","last_undegraded":"2024-05-09T12:20:22.632484+0000","last_fullsized":"2024-05-09T12:20:22.632484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633609+0000","last_change":"2024-05-09T12:20:21.631510+0000","last_active":"2024-05-09T12:20:22.633609+0000","last_peered":"2024-05-09T12:20:22.633609+0000","last_clean":"2024-05-09T12:20:22.633609+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:20:22.633609+0000","last_undegraded":"2024-05-09T12:20:22.633609+0000","last_fullsized":"2024-05-09T12:20:22.633609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631208+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:20:22.631208+0000","last_peered":"2024-05-09T12:20:22.631208+0000","last_clean":"2024-05-09T12:20:22.631208+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:20:22.631208+0000","last_undegraded":"2024-05-09T12:20:22.631208+0000","last_fullsized":"2024-05-09T12:20:22.631208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631983+0000","last_change":"2024-05-09T12:20:21.632437+0000","last_active":"2024-05-09T12:20:22.631983+0000","last_peered":"2024-05-09T12:20:22.631983+0000","last_clean":"2024-05-09T12:20:22.631983+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:20:22.631983+0000","last_undegraded":"2024-05-09T12:20:22.631983+0000","last_fullsized":"2024-05-09T12:20:22.631983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633694+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:22.633694+0000","last_peered":"2024-05-09T12:20:22.633694+0000","last_clean":"2024-05-09T12:20:22.633694+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:22.633694+0000","last_undegraded":"2024-05-09T12:20:22.633694+0000","last_fullsized":"2024-05-09T12:20:22.633694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633830+0000","last_change":"2024-05-09T12:20:21.643674+0000","last_active":"2024-05-09T12:20:22.633830+0000","last_peered":"2024-05-09T12:20:22.633830+0000","last_clean":"2024-05-09T12:20:22.633830+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:20:22.633830+0000","last_undegraded":"2024-05-09T12:20:22.633830+0000","last_fullsized":"2024-05-09T12:20:22.633830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:10.597391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632543+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:22.632543+0000","last_peered":"2024-05-09T12:20:22.632543+0000","last_clean":"2024-05-09T12:20:22.632543+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:22.632543+0000","last_undegraded":"2024-05-09T12:20:22.632543+0000","last_fullsized":"2024-05-09T12:20:22.632543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633165+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:20:22.633165+0000","last_peered":"2024-05-09T12:20:22.633165+0000","last_clean":"2024-05-09T12:20:22.633165+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:20:22.633165+0000","last_undegraded":"2024-05-09T12:20:22.633165+0000","last_fullsized":"2024-05-09T12:20:22.633165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632062+0000","last_change":"2024-05-09T12:20:21.633583+0000","last_active":"2024-05-09T12:20:22.632062+0000","last_peered":"2024-05-09T12:20:22.632062+0000","last_clean":"2024-05-09T12:20:22.632062+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:20:22.632062+0000","last_undegraded":"2024-05-09T12:20:22.632062+0000","last_fullsized":"2024-05-09T12:20:22.632062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632628+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:22.632628+0000","last_peered":"2024-05-09T12:20:22.632628+0000","last_clean":"2024-05-09T12:20:22.632628+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:22.632628+0000","last_undegraded":"2024-05-09T12:20:22.632628+0000","last_fullsized":"2024-05-09T12:20:22.632628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631312+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:20:22.631312+0000","last_peered":"2024-05-09T12:20:22.631312+0000","last_clean":"2024-05-09T12:20:22.631312+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:20:22.631312+0000","last_undegraded":"2024-05-09T12:20:22.631312+0000","last_fullsized":"2024-05-09T12:20:22.631312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632143+0000","last_change":"2024-05-09T12:20:21.632822+0000","last_active":"2024-05-09T12:20:22.632143+0000","last_peered":"2024-05-09T12:20:22.632143+0000","last_clean":"2024-05-09T12:20:22.632143+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:20:22.632143+0000","last_undegraded":"2024-05-09T12:20:22.632143+0000","last_fullsized":"2024-05-09T12:20:22.632143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631884+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:22.631884+0000","last_peered":"2024-05-09T12:20:22.631884+0000","last_clean":"2024-05-09T12:20:22.631884+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:22.631884+0000","last_undegraded":"2024-05-09T12:20:22.631884+0000","last_fullsized":"2024-05-09T12:20:22.631884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633858+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:22.633858+0000","last_peered":"2024-05-09T12:20:22.633858+0000","last_clean":"2024-05-09T12:20:22.633858+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:22.633858+0000","last_undegraded":"2024-05-09T12:20:22.633858+0000","last_fullsized":"2024-05-09T12:20:22.633858+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960462+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:20:22.960462+0000","last_peered":"2024-05-09T12:20:22.960462+0000","last_clean":"2024-05-09T12:20:22.960462+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:20:22.960462+0000","last_undegraded":"2024-05-09T12:20:22.960462+0000","last_fullsized":"2024-05-09T12:20:22.960462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960642+0000","last_change":"2024-05-09T12:20:21.634170+0000","last_active":"2024-05-09T12:20:22.960642+0000","last_peered":"2024-05-09T12:20:22.960642+0000","last_clean":"2024-05-09T12:20:22.960642+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:20:22.960642+0000","last_undegraded":"2024-05-09T12:20:22.960642+0000","last_fullsized":"2024-05-09T12:20:22.960642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:23.629858+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:20:23.629858+0000","last_peered":"2024-05-09T12:20:23.629858+0000","last_clean":"2024-05-09T12:20:23.629858+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:20:23.629858+0000","last_undegraded":"2024-05-09T12:20:23.629858+0000","last_fullsized":"2024-05-09T12:20:23.629858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632132+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:22.632132+0000","last_peered":"2024-05-09T12:20:22.632132+0000","last_clean":"2024-05-09T12:20:22.632132+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:22.632132+0000","last_undegraded":"2024-05-09T12:20:22.632132+0000","last_fullsized":"2024-05-09T12:20:22.632132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632858+0000","last_change":"2024-05-09T12:20:21.631044+0000","last_active":"2024-05-09T12:20:22.632858+0000","last_peered":"2024-05-09T12:20:22.632858+0000","last_clean":"2024-05-09T12:20:22.632858+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:20:22.632858+0000","last_undegraded":"2024-05-09T12:20:22.632858+0000","last_fullsized":"2024-05-09T12:20:22.632858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632267+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:20:22.632267+0000","last_peered":"2024-05-09T12:20:22.632267+0000","last_clean":"2024-05-09T12:20:22.632267+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:20:22.632267+0000","last_undegraded":"2024-05-09T12:20:22.632267+0000","last_fullsized":"2024-05-09T12:20:22.632267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633788+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:22.633788+0000","last_peered":"2024-05-09T12:20:22.633788+0000","last_clean":"2024-05-09T12:20:22.633788+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:22.633788+0000","last_undegraded":"2024-05-09T12:20:22.633788+0000","last_fullsized":"2024-05-09T12:20:22.633788+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960218+0000","last_change":"2024-05-09T12:20:21.636481+0000","last_active":"2024-05-09T12:20:22.960218+0000","last_peered":"2024-05-09T12:20:22.960218+0000","last_clean":"2024-05-09T12:20:22.960218+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:20:22.960218+0000","last_undegraded":"2024-05-09T12:20:22.960218+0000","last_fullsized":"2024-05-09T12:20:22.960218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632105+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:20:22.632105+0000","last_peered":"2024-05-09T12:20:22.632105+0000","last_clean":"2024-05-09T12:20:22.632105+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:20:22.632105+0000","last_undegraded":"2024-05-09T12:20:22.632105+0000","last_fullsized":"2024-05-09T12:20:22.632105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633121+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:22.633121+0000","last_peered":"2024-05-09T12:20:22.633121+0000","last_clean":"2024-05-09T12:20:22.633121+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:22.633121+0000","last_undegraded":"2024-05-09T12:20:22.633121+0000","last_fullsized":"2024-05-09T12:20:22.633121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961013+0000","last_change":"2024-05-09T12:20:21.641170+0000","last_active":"2024-05-09T12:20:22.961013+0000","last_peered":"2024-05-09T12:20:22.961013+0000","last_clean":"2024-05-09T12:20:22.961013+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:20:22.961013+0000","last_undegraded":"2024-05-09T12:20:22.961013+0000","last_fullsized":"2024-05-09T12:20:22.961013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633653+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:20:22.633653+0000","last_peered":"2024-05-09T12:20:22.633653+0000","last_clean":"2024-05-09T12:20:22.633653+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:20:22.633653+0000","last_undegraded":"2024-05-09T12:20:22.633653+0000","last_fullsized":"2024-05-09T12:20:22.633653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633735+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:22.633735+0000","last_peered":"2024-05-09T12:20:22.633735+0000","last_clean":"2024-05-09T12:20:22.633735+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:22.633735+0000","last_undegraded":"2024-05-09T12:20:22.633735+0000","last_fullsized":"2024-05-09T12:20:22.633735+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631463+0000","last_change":"2024-05-09T12:20:21.630541+0000","last_active":"2024-05-09T12:20:22.631463+0000","last_peered":"2024-05-09T12:20:22.631463+0000","last_clean":"2024-05-09T12:20:22.631463+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:20:22.631463+0000","last_undegraded":"2024-05-09T12:20:22.631463+0000","last_fullsized":"2024-05-09T12:20:22.631463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633063+0000","last_change":"2024-05-09T12:20:21.630924+0000","last_active":"2024-05-09T12:20:22.633063+0000","last_peered":"2024-05-09T12:20:22.633063+0000","last_clean":"2024-05-09T12:20:22.633063+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:20:22.633063+0000","last_undegraded":"2024-05-09T12:20:22.633063+0000","last_fullsized":"2024-05-09T12:20:22.633063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633061+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:20:22.633061+0000","last_peered":"2024-05-09T12:20:22.633061+0000","last_clean":"2024-05-09T12:20:22.633061+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:20:22.633061+0000","last_undegraded":"2024-05-09T12:20:22.633061+0000","last_fullsized":"2024-05-09T12:20:22.633061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631908+0000","last_change":"2024-05-09T12:20:21.635202+0000","last_active":"2024-05-09T12:20:22.631908+0000","last_peered":"2024-05-09T12:20:22.631908+0000","last_clean":"2024-05-09T12:20:22.631908+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:20:22.631908+0000","last_undegraded":"2024-05-09T12:20:22.631908+0000","last_fullsized":"2024-05-09T12:20:22.631908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633873+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:20:22.633873+0000","last_peered":"2024-05-09T12:20:22.633873+0000","last_clean":"2024-05-09T12:20:22.633873+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:20:22.633873+0000","last_undegraded":"2024-05-09T12:20:22.633873+0000","last_fullsized":"2024-05-09T12:20:22.633873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633713+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:20:22.633713+0000","last_peered":"2024-05-09T12:20:22.633713+0000","last_clean":"2024-05-09T12:20:22.633713+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:20:22.633713+0000","last_undegraded":"2024-05-09T12:20:22.633713+0000","last_fullsized":"2024-05-09T12:20:22.633713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960371+0000","last_change":"2024-05-09T12:20:21.633256+0000","last_active":"2024-05-09T12:20:22.960371+0000","last_peered":"2024-05-09T12:20:22.960371+0000","last_clean":"2024-05-09T12:20:22.960371+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:20:22.960371+0000","last_undegraded":"2024-05-09T12:20:22.960371+0000","last_fullsized":"2024-05-09T12:20:22.960371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960984+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:20:22.960984+0000","last_peered":"2024-05-09T12:20:22.960984+0000","last_clean":"2024-05-09T12:20:22.960984+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:20:22.960984+0000","last_undegraded":"2024-05-09T12:20:22.960984+0000","last_fullsized":"2024-05-09T12:20:22.960984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631089+0000","last_change":"2024-05-09T12:20:21.635653+0000","last_active":"2024-05-09T12:20:22.631089+0000","last_peered":"2024-05-09T12:20:22.631089+0000","last_clean":"2024-05-09T12:20:22.631089+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:20:22.631089+0000","last_undegraded":"2024-05-09T12:20:22.631089+0000","last_fullsized":"2024-05-09T12:20:22.631089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633343+0000","last_change":"2024-05-09T12:20:21.644065+0000","last_active":"2024-05-09T12:20:22.633343+0000","last_peered":"2024-05-09T12:20:22.633343+0000","last_clean":"2024-05-09T12:20:22.633343+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:20:22.633343+0000","last_undegraded":"2024-05-09T12:20:22.633343+0000","last_fullsized":"2024-05-09T12:20:22.633343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:33.210315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631220+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:20:22.631220+0000","last_peered":"2024-05-09T12:20:22.631220+0000","last_clean":"2024-05-09T12:20:22.631220+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:20:22.631220+0000","last_undegraded":"2024-05-09T12:20:22.631220+0000","last_fullsized":"2024-05-09T12:20:22.631220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960567+0000","last_change":"2024-05-09T12:20:21.633601+0000","last_active":"2024-05-09T12:20:22.960567+0000","last_peered":"2024-05-09T12:20:22.960567+0000","last_clean":"2024-05-09T12:20:22.960567+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:20:22.960567+0000","last_undegraded":"2024-05-09T12:20:22.960567+0000","last_fullsized":"2024-05-09T12:20:22.960567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631280+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:20:22.631280+0000","last_peered":"2024-05-09T12:20:22.631280+0000","last_clean":"2024-05-09T12:20:22.631280+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:20:22.631280+0000","last_undegraded":"2024-05-09T12:20:22.631280+0000","last_fullsized":"2024-05-09T12:20:22.631280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960921+0000","last_change":"2024-05-09T12:20:21.638359+0000","last_active":"2024-05-09T12:20:22.960921+0000","last_peered":"2024-05-09T12:20:22.960921+0000","last_clean":"2024-05-09T12:20:22.960921+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:20:22.960921+0000","last_undegraded":"2024-05-09T12:20:22.960921+0000","last_fullsized":"2024-05-09T12:20:22.960921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632563+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:20:22.632563+0000","last_peered":"2024-05-09T12:20:22.632563+0000","last_clean":"2024-05-09T12:20:22.632563+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:20:22.632563+0000","last_undegraded":"2024-05-09T12:20:22.632563+0000","last_fullsized":"2024-05-09T12:20:22.632563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631862+0000","last_change":"2024-05-09T12:20:21.634182+0000","last_active":"2024-05-09T12:20:22.631862+0000","last_peered":"2024-05-09T12:20:22.631862+0000","last_clean":"2024-05-09T12:20:22.631862+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:20:22.631862+0000","last_undegraded":"2024-05-09T12:20:22.631862+0000","last_fullsized":"2024-05-09T12:20:22.631862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961067+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:20:22.961067+0000","last_peered":"2024-05-09T12:20:22.961067+0000","last_clean":"2024-05-09T12:20:22.961067+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:20:22.961067+0000","last_undegraded":"2024-05-09T12:20:22.961067+0000","last_fullsized":"2024-05-09T12:20:22.961067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633289+0000","last_change":"2024-05-09T12:20:21.638295+0000","last_active":"2024-05-09T12:20:22.633289+0000","last_peered":"2024-05-09T12:20:22.633289+0000","last_clean":"2024-05-09T12:20:22.633289+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:20:22.633289+0000","last_undegraded":"2024-05-09T12:20:22.633289+0000","last_fullsized":"2024-05-09T12:20:22.633289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632470+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:20:22.632470+0000","last_peered":"2024-05-09T12:20:22.632470+0000","last_clean":"2024-05-09T12:20:22.632470+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:20:22.632470+0000","last_undegraded":"2024-05-09T12:20:22.632470+0000","last_fullsized":"2024-05-09T12:20:22.632470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632133+0000","last_change":"2024-05-09T12:20:21.642394+0000","last_active":"2024-05-09T12:20:22.632133+0000","last_peered":"2024-05-09T12:20:22.632133+0000","last_clean":"2024-05-09T12:20:22.632133+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:20:22.632133+0000","last_undegraded":"2024-05-09T12:20:22.632133+0000","last_fullsized":"2024-05-09T12:20:22.632133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633690+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:20:22.633690+0000","last_peered":"2024-05-09T12:20:22.633690+0000","last_clean":"2024-05-09T12:20:22.633690+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:20:22.633690+0000","last_undegraded":"2024-05-09T12:20:22.633690+0000","last_fullsized":"2024-05-09T12:20:22.633690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960335+0000","last_change":"2024-05-09T12:20:21.634325+0000","last_active":"2024-05-09T12:20:22.960335+0000","last_peered":"2024-05-09T12:20:22.960335+0000","last_clean":"2024-05-09T12:20:22.960335+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:20:22.960335+0000","last_undegraded":"2024-05-09T12:20:22.960335+0000","last_fullsized":"2024-05-09T12:20:22.960335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960858+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:20:22.960858+0000","last_peered":"2024-05-09T12:20:22.960858+0000","last_clean":"2024-05-09T12:20:22.960858+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:20:22.960858+0000","last_undegraded":"2024-05-09T12:20:22.960858+0000","last_fullsized":"2024-05-09T12:20:22.960858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631969+0000","last_change":"2024-05-09T12:20:21.638597+0000","last_active":"2024-05-09T12:20:22.631969+0000","last_peered":"2024-05-09T12:20:22.631969+0000","last_clean":"2024-05-09T12:20:22.631969+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:20:22.631969+0000","last_undegraded":"2024-05-09T12:20:22.631969+0000","last_fullsized":"2024-05-09T12:20:22.631969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960843+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:20:22.960843+0000","last_peered":"2024-05-09T12:20:22.960843+0000","last_clean":"2024-05-09T12:20:22.960843+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:20:22.960843+0000","last_undegraded":"2024-05-09T12:20:22.960843+0000","last_fullsized":"2024-05-09T12:20:22.960843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":646638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":55708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":644318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":54692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:29.045 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:29.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.155+0000 7fde821c0640 1 Processor -- start 2024-05-09T12:20:29.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.155+0000 7fde821c0640 1 -- start start 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c09e340 0x7fde7c09e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde7c13a5e0 0x7fde7c13aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fde7c13af80 0x7fde7c141910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde7c074150 con 0x7fde7c13a5e0 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fde7c09f140 con 0x7fde7c13af80 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde821c0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fde7c09c230 con 0x7fde7c09e340 2024-05-09T12:20:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde7c13a5e0 0x7fde7c13aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde7c13a5e0 0x7fde7c13aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40970/0 (socket says 172.21.15.135:40970) 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 -- 172.21.15.135:0/3336001646 learned_addr learned my addr 172.21.15.135:0/3336001646 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7bfff640 1 --2- 172.21.15.135:0/3336001646 >> v2:172.21.15.160:3300/0 conn(0x7fde7c13af80 0x7fde7c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7b7fe640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c09e340 0x7fde7c09e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 -- 172.21.15.135:0/3336001646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c09e340 msgr2=0x7fde7c09e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c09e340 0x7fde7c09e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 -- 172.21.15.135:0/3336001646 >> v2:172.21.15.160:3300/0 conn(0x7fde7c13af80 msgr2=0x7fde7c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 --2- 172.21.15.135:0/3336001646 >> v2:172.21.15.160:3300/0 conn(0x7fde7c13af80 0x7fde7c141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.156+0000 7fde7affd640 1 -- 172.21.15.135:0/3336001646 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7c13b410 con 0x7fde7c13a5e0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.157+0000 7fde7affd640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13a5e0 0x7fde7c13aa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde7c06d190 tx=0x7fde6402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ff1f13bea8ac92 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.157+0000 7fde7a7fc640 1 -- 172.21.15.135:0/3336001646 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6402e070 con 0x7fde7c13a5e0 2024-05-09T12:20:29.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.157+0000 7fde7a7fc640 1 -- 172.21.15.135:0/3336001646 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde64037070 con 0x7fde7c13a5e0 2024-05-09T12:20:29.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.157+0000 7fde7a7fc640 1 -- 172.21.15.135:0/3336001646 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64031a00 con 0x7fde7c13a5e0 2024-05-09T12:20:29.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 -- 172.21.15.135:0/3336001646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13a5e0 msgr2=0x7fde7c13aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13a5e0 0x7fde7c13aa40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde7c06d190 tx=0x7fde6402b880 comp rx=0 tx=0).stop 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 -- 172.21.15.135:0/3336001646 shutdown_connections 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 --2- 172.21.15.135:0/3336001646 >> v2:172.21.15.160:3300/0 conn(0x7fde7c13af80 0x7fde7c141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13a5e0 0x7fde7c13aa40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 --2- 172.21.15.135:0/3336001646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c09e340 0x7fde7c09e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 -- 172.21.15.135:0/3336001646 >> 172.21.15.135:0/3336001646 conn(0x7fde7c0acb30 msgr2=0x7fde7c0acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 -- 172.21.15.135:0/3336001646 shutdown_connections 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.158+0000 7fde821c0640 1 -- 172.21.15.135:0/3336001646 wait complete. 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.159+0000 7fde821c0640 1 Processor -- start 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.159+0000 7fde821c0640 1 -- start start 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde7c09e340 0x7fde7c1d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c13a5e0 0x7fde7c1d2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde7c09caa0 con 0x7fde7c13af80 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fde7c09d680 con 0x7fde7c09e340 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde821c0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fde7c09c500 con 0x7fde7c13a5e0 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40974/0 (socket says 172.21.15.135:40974) 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 -- 172.21.15.135:0/600766989 learned_addr learned my addr 172.21.15.135:0/600766989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7b7fe640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde7c09e340 0x7fde7c1d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7affd640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c13a5e0 0x7fde7c1d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 -- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c13a5e0 msgr2=0x7fde7c1d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c13a5e0 0x7fde7c1d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 -- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde7c09e340 msgr2=0x7fde7c1d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde7c09e340 0x7fde7c1d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 -- 172.21.15.135:0/600766989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7c1241b0 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde7bfff640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde7400ec10 tx=0x7fde7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74018020 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.160+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7400cd20 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.161+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7c124710 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.161+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde740146c0 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.161+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7c125870 con 0x7fde7c13af80 2024-05-09T12:20:29.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.162+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7c0508d0 con 0x7fde7c13af80 2024-05-09T12:20:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.162+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde74005d10 con 0x7fde7c13af80 2024-05-09T12:20:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.163+0000 7fde73fff640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 0x7fde5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.163+0000 7fde7b7fe640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 0x7fde5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.163+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fde74097aa0 con 0x7fde7c13af80 2024-05-09T12:20:29.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.163+0000 7fde7b7fe640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 0x7fde5c078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009b30 tx=0x7fde6c009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.167+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde74022030 con 0x7fde7c13af80 2024-05-09T12:20:29.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.344+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde7c09c7f0 con 0x7fde5c0762d0 2024-05-09T12:20:29.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.350+0000 7fde73fff640 1 -- 172.21.15.135:0/600766989 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268589 (secure 0 0 0) 0x7fde6c011a60 con 0x7fde5c0762d0 2024-05-09T12:20:29.353 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:29.355 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 msgr2=0x7fde5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 0x7fde5c078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009b30 tx=0x7fde6c009110 comp rx=0 tx=0).stop 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 msgr2=0x7fde7c1d2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde7400ec10 tx=0x7fde7400c490 comp rx=0 tx=0).stop 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 shutdown_connections 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fde5c0762d0 0x7fde5c078790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde7c13af80 0x7fde7c1d2750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde7c13a5e0 0x7fde7c1d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 --2- 172.21.15.135:0/600766989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde7c09e340 0x7fde7c1d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 >> 172.21.15.135:0/600766989 conn(0x7fde7c0acb30 msgr2=0x7fde7c0a9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:29.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 shutdown_connections 2024-05-09T12:20:29.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.354+0000 7fde821c0640 1 -- 172.21.15.135:0/600766989 wait complete. 2024-05-09T12:20:29.364 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-09T12:20:27.374911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109952,"kb_used_data":1848,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377408,"statfs":{"total":386547056640,"available":386434465792,"internally_reserved":0,"allocated":1892352,"data_stored":1401356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.758362"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961005+0000","last_change":"2024-05-09T12:20:21.640078+0000","last_active":"2024-05-09T12:20:22.961005+0000","last_peered":"2024-05-09T12:20:22.961005+0000","last_clean":"2024-05-09T12:20:22.961005+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:20:22.961005+0000","last_undegraded":"2024-05-09T12:20:22.961005+0000","last_fullsized":"2024-05-09T12:20:22.961005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633805+0000","last_change":"2024-05-09T12:20:21.640588+0000","last_active":"2024-05-09T12:20:22.633805+0000","last_peered":"2024-05-09T12:20:22.633805+0000","last_clean":"2024-05-09T12:20:22.633805+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:20:22.633805+0000","last_undegraded":"2024-05-09T12:20:22.633805+0000","last_fullsized":"2024-05-09T12:20:22.633805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633146+0000","last_change":"2024-05-09T12:20:21.639557+0000","last_active":"2024-05-09T12:20:22.633146+0000","last_peered":"2024-05-09T12:20:22.633146+0000","last_clean":"2024-05-09T12:20:22.633146+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:20:22.633146+0000","last_undegraded":"2024-05-09T12:20:22.633146+0000","last_fullsized":"2024-05-09T12:20:22.633146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:37.437914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632341+0000","last_change":"2024-05-09T12:20:21.641474+0000","last_active":"2024-05-09T12:20:22.632341+0000","last_peered":"2024-05-09T12:20:22.632341+0000","last_clean":"2024-05-09T12:20:22.632341+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:20:22.632341+0000","last_undegraded":"2024-05-09T12:20:22.632341+0000","last_fullsized":"2024-05-09T12:20:22.632341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960955+0000","last_change":"2024-05-09T12:20:21.641137+0000","last_active":"2024-05-09T12:20:22.960955+0000","last_peered":"2024-05-09T12:20:22.960955+0000","last_clean":"2024-05-09T12:20:22.960955+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:20:22.960955+0000","last_undegraded":"2024-05-09T12:20:22.960955+0000","last_fullsized":"2024-05-09T12:20:22.960955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631841+0000","last_change":"2024-05-09T12:20:21.637744+0000","last_active":"2024-05-09T12:20:22.631841+0000","last_peered":"2024-05-09T12:20:22.631841+0000","last_clean":"2024-05-09T12:20:22.631841+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:20:22.631841+0000","last_undegraded":"2024-05-09T12:20:22.631841+0000","last_fullsized":"2024-05-09T12:20:22.631841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632362+0000","last_change":"2024-05-09T12:20:21.641996+0000","last_active":"2024-05-09T12:20:22.632362+0000","last_peered":"2024-05-09T12:20:22.632362+0000","last_clean":"2024-05-09T12:20:22.632362+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:20:22.632362+0000","last_undegraded":"2024-05-09T12:20:22.632362+0000","last_fullsized":"2024-05-09T12:20:22.632362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632430+0000","last_change":"2024-05-09T12:20:21.637546+0000","last_active":"2024-05-09T12:20:22.632430+0000","last_peered":"2024-05-09T12:20:22.632430+0000","last_clean":"2024-05-09T12:20:22.632430+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:20:22.632430+0000","last_undegraded":"2024-05-09T12:20:22.632430+0000","last_fullsized":"2024-05-09T12:20:22.632430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960747+0000","last_change":"2024-05-09T12:20:21.640522+0000","last_active":"2024-05-09T12:20:22.960747+0000","last_peered":"2024-05-09T12:20:22.960747+0000","last_clean":"2024-05-09T12:20:22.960747+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:20:22.960747+0000","last_undegraded":"2024-05-09T12:20:22.960747+0000","last_fullsized":"2024-05-09T12:20:22.960747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632891+0000","last_change":"2024-05-09T12:20:21.642468+0000","last_active":"2024-05-09T12:20:22.632891+0000","last_peered":"2024-05-09T12:20:22.632891+0000","last_clean":"2024-05-09T12:20:22.632891+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:20:22.632891+0000","last_undegraded":"2024-05-09T12:20:22.632891+0000","last_fullsized":"2024-05-09T12:20:22.632891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633090+0000","last_change":"2024-05-09T12:20:21.634590+0000","last_active":"2024-05-09T12:20:22.633090+0000","last_peered":"2024-05-09T12:20:22.633090+0000","last_clean":"2024-05-09T12:20:22.633090+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:20:22.633090+0000","last_undegraded":"2024-05-09T12:20:22.633090+0000","last_fullsized":"2024-05-09T12:20:22.633090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631426+0000","last_change":"2024-05-09T12:20:21.630566+0000","last_active":"2024-05-09T12:20:22.631426+0000","last_peered":"2024-05-09T12:20:22.631426+0000","last_clean":"2024-05-09T12:20:22.631426+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:20:22.631426+0000","last_undegraded":"2024-05-09T12:20:22.631426+0000","last_fullsized":"2024-05-09T12:20:22.631426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960373+0000","last_change":"2024-05-09T12:20:21.642290+0000","last_active":"2024-05-09T12:20:22.960373+0000","last_peered":"2024-05-09T12:20:22.960373+0000","last_clean":"2024-05-09T12:20:22.960373+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:20:22.960373+0000","last_undegraded":"2024-05-09T12:20:22.960373+0000","last_fullsized":"2024-05-09T12:20:22.960373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631972+0000","last_change":"2024-05-09T12:20:21.636007+0000","last_active":"2024-05-09T12:20:22.631972+0000","last_peered":"2024-05-09T12:20:22.631972+0000","last_clean":"2024-05-09T12:20:22.631972+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:20:22.631972+0000","last_undegraded":"2024-05-09T12:20:22.631972+0000","last_fullsized":"2024-05-09T12:20:22.631972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632535+0000","last_change":"2024-05-09T12:20:21.640762+0000","last_active":"2024-05-09T12:20:22.632535+0000","last_peered":"2024-05-09T12:20:22.632535+0000","last_clean":"2024-05-09T12:20:22.632535+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:20:22.632535+0000","last_undegraded":"2024-05-09T12:20:22.632535+0000","last_fullsized":"2024-05-09T12:20:22.632535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633618+0000","last_change":"2024-05-09T12:20:21.635550+0000","last_active":"2024-05-09T12:20:22.633618+0000","last_peered":"2024-05-09T12:20:22.633618+0000","last_clean":"2024-05-09T12:20:22.633618+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:20:22.633618+0000","last_undegraded":"2024-05-09T12:20:22.633618+0000","last_fullsized":"2024-05-09T12:20:22.633618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:13:25.977279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960675+0000","last_change":"2024-05-09T12:20:21.640922+0000","last_active":"2024-05-09T12:20:22.960675+0000","last_peered":"2024-05-09T12:20:22.960675+0000","last_clean":"2024-05-09T12:20:22.960675+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:20:22.960675+0000","last_undegraded":"2024-05-09T12:20:22.960675+0000","last_fullsized":"2024-05-09T12:20:22.960675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633064+0000","last_change":"2024-05-09T12:20:21.639291+0000","last_active":"2024-05-09T12:20:22.633064+0000","last_peered":"2024-05-09T12:20:22.633064+0000","last_clean":"2024-05-09T12:20:22.633064+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:20:22.633064+0000","last_undegraded":"2024-05-09T12:20:22.633064+0000","last_fullsized":"2024-05-09T12:20:22.633064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:57.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960841+0000","last_change":"2024-05-09T12:20:21.636709+0000","last_active":"2024-05-09T12:20:22.960841+0000","last_peered":"2024-05-09T12:20:22.960841+0000","last_clean":"2024-05-09T12:20:22.960841+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:20:22.960841+0000","last_undegraded":"2024-05-09T12:20:22.960841+0000","last_fullsized":"2024-05-09T12:20:22.960841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632942+0000","last_change":"2024-05-09T12:20:21.637072+0000","last_active":"2024-05-09T12:20:22.632942+0000","last_peered":"2024-05-09T12:20:22.632942+0000","last_clean":"2024-05-09T12:20:22.632942+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:20:22.632942+0000","last_undegraded":"2024-05-09T12:20:22.632942+0000","last_fullsized":"2024-05-09T12:20:22.632942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632736+0000","last_change":"2024-05-09T12:20:21.638705+0000","last_active":"2024-05-09T12:20:22.632736+0000","last_peered":"2024-05-09T12:20:22.632736+0000","last_clean":"2024-05-09T12:20:22.632736+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:20:22.632736+0000","last_undegraded":"2024-05-09T12:20:22.632736+0000","last_fullsized":"2024-05-09T12:20:22.632736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960312+0000","last_change":"2024-05-09T12:20:21.634342+0000","last_active":"2024-05-09T12:20:22.960312+0000","last_peered":"2024-05-09T12:20:22.960312+0000","last_clean":"2024-05-09T12:20:22.960312+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:20:22.960312+0000","last_undegraded":"2024-05-09T12:20:22.960312+0000","last_fullsized":"2024-05-09T12:20:22.960312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631183+0000","last_change":"2024-05-09T12:20:21.637932+0000","last_active":"2024-05-09T12:20:22.631183+0000","last_peered":"2024-05-09T12:20:22.631183+0000","last_clean":"2024-05-09T12:20:22.631183+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:20:22.631183+0000","last_undegraded":"2024-05-09T12:20:22.631183+0000","last_fullsized":"2024-05-09T12:20:22.631183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632621+0000","last_change":"2024-05-09T12:20:21.637783+0000","last_active":"2024-05-09T12:20:22.632621+0000","last_peered":"2024-05-09T12:20:22.632621+0000","last_clean":"2024-05-09T12:20:22.632621+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:20:22.632621+0000","last_undegraded":"2024-05-09T12:20:22.632621+0000","last_fullsized":"2024-05-09T12:20:22.632621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631842+0000","last_change":"2024-05-09T12:20:21.631135+0000","last_active":"2024-05-09T12:20:22.631842+0000","last_peered":"2024-05-09T12:20:22.631842+0000","last_clean":"2024-05-09T12:20:22.631842+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:20:22.631842+0000","last_undegraded":"2024-05-09T12:20:22.631842+0000","last_fullsized":"2024-05-09T12:20:22.631842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631710+0000","last_change":"2024-05-09T12:20:21.634947+0000","last_active":"2024-05-09T12:20:22.631710+0000","last_peered":"2024-05-09T12:20:22.631710+0000","last_clean":"2024-05-09T12:20:22.631710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:20:22.631710+0000","last_undegraded":"2024-05-09T12:20:22.631710+0000","last_fullsized":"2024-05-09T12:20:22.631710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633466+0000","last_change":"2024-05-09T12:20:21.639631+0000","last_active":"2024-05-09T12:20:22.633466+0000","last_peered":"2024-05-09T12:20:22.633466+0000","last_clean":"2024-05-09T12:20:22.633466+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:20:22.633466+0000","last_undegraded":"2024-05-09T12:20:22.633466+0000","last_fullsized":"2024-05-09T12:20:22.633466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:22.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:21.644243+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960667+0000","last_change":"2024-05-09T12:20:21.641857+0000","last_active":"2024-05-09T12:20:22.960667+0000","last_peered":"2024-05-09T12:20:22.960667+0000","last_clean":"2024-05-09T12:20:22.960667+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:20:22.960667+0000","last_undegraded":"2024-05-09T12:20:22.960667+0000","last_fullsized":"2024-05-09T12:20:22.960667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631990+0000","last_change":"2024-05-09T12:20:21.638340+0000","last_active":"2024-05-09T12:20:22.631990+0000","last_peered":"2024-05-09T12:20:22.631990+0000","last_clean":"2024-05-09T12:20:22.631990+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:20:22.631990+0000","last_undegraded":"2024-05-09T12:20:22.631990+0000","last_fullsized":"2024-05-09T12:20:22.631990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631085+0000","last_change":"2024-05-09T12:20:21.634751+0000","last_active":"2024-05-09T12:20:22.631085+0000","last_peered":"2024-05-09T12:20:22.631085+0000","last_clean":"2024-05-09T12:20:22.631085+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:20:22.631085+0000","last_undegraded":"2024-05-09T12:20:22.631085+0000","last_fullsized":"2024-05-09T12:20:22.631085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631736+0000","last_change":"2024-05-09T12:20:21.636322+0000","last_active":"2024-05-09T12:20:22.631736+0000","last_peered":"2024-05-09T12:20:22.631736+0000","last_clean":"2024-05-09T12:20:22.631736+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:20:22.631736+0000","last_undegraded":"2024-05-09T12:20:22.631736+0000","last_fullsized":"2024-05-09T12:20:22.631736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:01.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632003+0000","last_change":"2024-05-09T12:20:21.644274+0000","last_active":"2024-05-09T12:20:22.632003+0000","last_peered":"2024-05-09T12:20:22.632003+0000","last_clean":"2024-05-09T12:20:22.632003+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:20:22.632003+0000","last_undegraded":"2024-05-09T12:20:22.632003+0000","last_fullsized":"2024-05-09T12:20:22.632003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632909+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:20:22.632909+0000","last_peered":"2024-05-09T12:20:22.632909+0000","last_clean":"2024-05-09T12:20:22.632909+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:20:22.632909+0000","last_undegraded":"2024-05-09T12:20:22.632909+0000","last_fullsized":"2024-05-09T12:20:22.632909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633947+0000","last_change":"2024-05-09T12:20:21.644211+0000","last_active":"2024-05-09T12:20:22.633947+0000","last_peered":"2024-05-09T12:20:22.633947+0000","last_clean":"2024-05-09T12:20:22.633947+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:20:22.633947+0000","last_undegraded":"2024-05-09T12:20:22.633947+0000","last_fullsized":"2024-05-09T12:20:22.633947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:14:09.661175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960243+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:20:22.960243+0000","last_peered":"2024-05-09T12:20:22.960243+0000","last_clean":"2024-05-09T12:20:22.960243+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:20:22.960243+0000","last_undegraded":"2024-05-09T12:20:22.960243+0000","last_fullsized":"2024-05-09T12:20:22.960243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960788+0000","last_change":"2024-05-09T12:20:21.636434+0000","last_active":"2024-05-09T12:20:22.960788+0000","last_peered":"2024-05-09T12:20:22.960788+0000","last_clean":"2024-05-09T12:20:22.960788+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:20:22.960788+0000","last_undegraded":"2024-05-09T12:20:22.960788+0000","last_fullsized":"2024-05-09T12:20:22.960788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633456+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:20:22.633456+0000","last_peered":"2024-05-09T12:20:22.633456+0000","last_clean":"2024-05-09T12:20:22.633456+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:20:22.633456+0000","last_undegraded":"2024-05-09T12:20:22.633456+0000","last_fullsized":"2024-05-09T12:20:22.633456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960804+0000","last_change":"2024-05-09T12:20:21.639841+0000","last_active":"2024-05-09T12:20:22.960804+0000","last_peered":"2024-05-09T12:20:22.960804+0000","last_clean":"2024-05-09T12:20:22.960804+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:20:22.960804+0000","last_undegraded":"2024-05-09T12:20:22.960804+0000","last_fullsized":"2024-05-09T12:20:22.960804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633556+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:20:22.633556+0000","last_peered":"2024-05-09T12:20:22.633556+0000","last_clean":"2024-05-09T12:20:22.633556+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:20:22.633556+0000","last_undegraded":"2024-05-09T12:20:22.633556+0000","last_fullsized":"2024-05-09T12:20:22.633556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633459+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:20:22.633459+0000","last_peered":"2024-05-09T12:20:22.633459+0000","last_clean":"2024-05-09T12:20:22.633459+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:20:22.633459+0000","last_undegraded":"2024-05-09T12:20:22.633459+0000","last_fullsized":"2024-05-09T12:20:22.633459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633360+0000","last_change":"2024-05-09T12:20:21.637705+0000","last_active":"2024-05-09T12:20:22.633360+0000","last_peered":"2024-05-09T12:20:22.633360+0000","last_clean":"2024-05-09T12:20:22.633360+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:20:22.633360+0000","last_undegraded":"2024-05-09T12:20:22.633360+0000","last_fullsized":"2024-05-09T12:20:22.633360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.118933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633827+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:20:22.633827+0000","last_peered":"2024-05-09T12:20:22.633827+0000","last_clean":"2024-05-09T12:20:22.633827+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:20:22.633827+0000","last_undegraded":"2024-05-09T12:20:22.633827+0000","last_fullsized":"2024-05-09T12:20:22.633827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632728+0000","last_change":"2024-05-09T12:20:21.641492+0000","last_active":"2024-05-09T12:20:22.632728+0000","last_peered":"2024-05-09T12:20:22.632728+0000","last_clean":"2024-05-09T12:20:22.632728+0000","last_became_active":"2024-05-09T12:20:21.640732+0000","last_became_peered":"2024-05-09T12:20:21.640732+0000","last_unstale":"2024-05-09T12:20:22.632728+0000","last_undegraded":"2024-05-09T12:20:22.632728+0000","last_fullsized":"2024-05-09T12:20:22.632728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633937+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:20:22.633937+0000","last_peered":"2024-05-09T12:20:22.633937+0000","last_clean":"2024-05-09T12:20:22.633937+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:20:22.633937+0000","last_undegraded":"2024-05-09T12:20:22.633937+0000","last_fullsized":"2024-05-09T12:20:22.633937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633355+0000","last_change":"2024-05-09T12:20:21.631032+0000","last_active":"2024-05-09T12:20:22.633355+0000","last_peered":"2024-05-09T12:20:22.633355+0000","last_clean":"2024-05-09T12:20:22.633355+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:20:22.633355+0000","last_undegraded":"2024-05-09T12:20:22.633355+0000","last_fullsized":"2024-05-09T12:20:22.633355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633192+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:20:22.633192+0000","last_peered":"2024-05-09T12:20:22.633192+0000","last_clean":"2024-05-09T12:20:22.633192+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:20:22.633192+0000","last_undegraded":"2024-05-09T12:20:22.633192+0000","last_fullsized":"2024-05-09T12:20:22.633192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960799+0000","last_change":"2024-05-09T12:20:21.641618+0000","last_active":"2024-05-09T12:20:22.960799+0000","last_peered":"2024-05-09T12:20:22.960799+0000","last_clean":"2024-05-09T12:20:22.960799+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:20:22.960799+0000","last_undegraded":"2024-05-09T12:20:22.960799+0000","last_fullsized":"2024-05-09T12:20:22.960799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631757+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:20:22.631757+0000","last_peered":"2024-05-09T12:20:22.631757+0000","last_clean":"2024-05-09T12:20:22.631757+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:20:22.631757+0000","last_undegraded":"2024-05-09T12:20:22.631757+0000","last_fullsized":"2024-05-09T12:20:22.631757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633261+0000","last_change":"2024-05-09T12:20:21.639712+0000","last_active":"2024-05-09T12:20:22.633261+0000","last_peered":"2024-05-09T12:20:22.633261+0000","last_clean":"2024-05-09T12:20:22.633261+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:20:22.633261+0000","last_undegraded":"2024-05-09T12:20:22.633261+0000","last_fullsized":"2024-05-09T12:20:22.633261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:55.515277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632264+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:20:22.632264+0000","last_peered":"2024-05-09T12:20:22.632264+0000","last_clean":"2024-05-09T12:20:22.632264+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:20:22.632264+0000","last_undegraded":"2024-05-09T12:20:22.632264+0000","last_fullsized":"2024-05-09T12:20:22.632264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633552+0000","last_change":"2024-05-09T12:20:21.643678+0000","last_active":"2024-05-09T12:20:22.633552+0000","last_peered":"2024-05-09T12:20:22.633552+0000","last_clean":"2024-05-09T12:20:22.633552+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:20:22.633552+0000","last_undegraded":"2024-05-09T12:20:22.633552+0000","last_fullsized":"2024-05-09T12:20:22.633552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:13.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632484+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:20:22.632484+0000","last_peered":"2024-05-09T12:20:22.632484+0000","last_clean":"2024-05-09T12:20:22.632484+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:20:22.632484+0000","last_undegraded":"2024-05-09T12:20:22.632484+0000","last_fullsized":"2024-05-09T12:20:22.632484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633609+0000","last_change":"2024-05-09T12:20:21.631510+0000","last_active":"2024-05-09T12:20:22.633609+0000","last_peered":"2024-05-09T12:20:22.633609+0000","last_clean":"2024-05-09T12:20:22.633609+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:20:22.633609+0000","last_undegraded":"2024-05-09T12:20:22.633609+0000","last_fullsized":"2024-05-09T12:20:22.633609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631208+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:20:22.631208+0000","last_peered":"2024-05-09T12:20:22.631208+0000","last_clean":"2024-05-09T12:20:22.631208+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:20:22.631208+0000","last_undegraded":"2024-05-09T12:20:22.631208+0000","last_fullsized":"2024-05-09T12:20:22.631208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631983+0000","last_change":"2024-05-09T12:20:21.632437+0000","last_active":"2024-05-09T12:20:22.631983+0000","last_peered":"2024-05-09T12:20:22.631983+0000","last_clean":"2024-05-09T12:20:22.631983+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:20:22.631983+0000","last_undegraded":"2024-05-09T12:20:22.631983+0000","last_fullsized":"2024-05-09T12:20:22.631983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633694+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:22.633694+0000","last_peered":"2024-05-09T12:20:22.633694+0000","last_clean":"2024-05-09T12:20:22.633694+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:22.633694+0000","last_undegraded":"2024-05-09T12:20:22.633694+0000","last_fullsized":"2024-05-09T12:20:22.633694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633830+0000","last_change":"2024-05-09T12:20:21.643674+0000","last_active":"2024-05-09T12:20:22.633830+0000","last_peered":"2024-05-09T12:20:22.633830+0000","last_clean":"2024-05-09T12:20:22.633830+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:20:22.633830+0000","last_undegraded":"2024-05-09T12:20:22.633830+0000","last_fullsized":"2024-05-09T12:20:22.633830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:10.597391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632543+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:22.632543+0000","last_peered":"2024-05-09T12:20:22.632543+0000","last_clean":"2024-05-09T12:20:22.632543+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:22.632543+0000","last_undegraded":"2024-05-09T12:20:22.632543+0000","last_fullsized":"2024-05-09T12:20:22.632543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633165+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:20:22.633165+0000","last_peered":"2024-05-09T12:20:22.633165+0000","last_clean":"2024-05-09T12:20:22.633165+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:20:22.633165+0000","last_undegraded":"2024-05-09T12:20:22.633165+0000","last_fullsized":"2024-05-09T12:20:22.633165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632062+0000","last_change":"2024-05-09T12:20:21.633583+0000","last_active":"2024-05-09T12:20:22.632062+0000","last_peered":"2024-05-09T12:20:22.632062+0000","last_clean":"2024-05-09T12:20:22.632062+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:20:22.632062+0000","last_undegraded":"2024-05-09T12:20:22.632062+0000","last_fullsized":"2024-05-09T12:20:22.632062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632628+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:22.632628+0000","last_peered":"2024-05-09T12:20:22.632628+0000","last_clean":"2024-05-09T12:20:22.632628+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:22.632628+0000","last_undegraded":"2024-05-09T12:20:22.632628+0000","last_fullsized":"2024-05-09T12:20:22.632628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631312+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:20:22.631312+0000","last_peered":"2024-05-09T12:20:22.631312+0000","last_clean":"2024-05-09T12:20:22.631312+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:20:22.631312+0000","last_undegraded":"2024-05-09T12:20:22.631312+0000","last_fullsized":"2024-05-09T12:20:22.631312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632143+0000","last_change":"2024-05-09T12:20:21.632822+0000","last_active":"2024-05-09T12:20:22.632143+0000","last_peered":"2024-05-09T12:20:22.632143+0000","last_clean":"2024-05-09T12:20:22.632143+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:20:22.632143+0000","last_undegraded":"2024-05-09T12:20:22.632143+0000","last_fullsized":"2024-05-09T12:20:22.632143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631884+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:22.631884+0000","last_peered":"2024-05-09T12:20:22.631884+0000","last_clean":"2024-05-09T12:20:22.631884+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:22.631884+0000","last_undegraded":"2024-05-09T12:20:22.631884+0000","last_fullsized":"2024-05-09T12:20:22.631884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633858+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:22.633858+0000","last_peered":"2024-05-09T12:20:22.633858+0000","last_clean":"2024-05-09T12:20:22.633858+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:22.633858+0000","last_undegraded":"2024-05-09T12:20:22.633858+0000","last_fullsized":"2024-05-09T12:20:22.633858+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960462+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:20:22.960462+0000","last_peered":"2024-05-09T12:20:22.960462+0000","last_clean":"2024-05-09T12:20:22.960462+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:20:22.960462+0000","last_undegraded":"2024-05-09T12:20:22.960462+0000","last_fullsized":"2024-05-09T12:20:22.960462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960642+0000","last_change":"2024-05-09T12:20:21.634170+0000","last_active":"2024-05-09T12:20:22.960642+0000","last_peered":"2024-05-09T12:20:22.960642+0000","last_clean":"2024-05-09T12:20:22.960642+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:20:22.960642+0000","last_undegraded":"2024-05-09T12:20:22.960642+0000","last_fullsized":"2024-05-09T12:20:22.960642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:23.629858+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:20:23.629858+0000","last_peered":"2024-05-09T12:20:23.629858+0000","last_clean":"2024-05-09T12:20:23.629858+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:20:23.629858+0000","last_undegraded":"2024-05-09T12:20:23.629858+0000","last_fullsized":"2024-05-09T12:20:23.629858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632132+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:22.632132+0000","last_peered":"2024-05-09T12:20:22.632132+0000","last_clean":"2024-05-09T12:20:22.632132+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:22.632132+0000","last_undegraded":"2024-05-09T12:20:22.632132+0000","last_fullsized":"2024-05-09T12:20:22.632132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632858+0000","last_change":"2024-05-09T12:20:21.631044+0000","last_active":"2024-05-09T12:20:22.632858+0000","last_peered":"2024-05-09T12:20:22.632858+0000","last_clean":"2024-05-09T12:20:22.632858+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:20:22.632858+0000","last_undegraded":"2024-05-09T12:20:22.632858+0000","last_fullsized":"2024-05-09T12:20:22.632858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632267+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:20:22.632267+0000","last_peered":"2024-05-09T12:20:22.632267+0000","last_clean":"2024-05-09T12:20:22.632267+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:20:22.632267+0000","last_undegraded":"2024-05-09T12:20:22.632267+0000","last_fullsized":"2024-05-09T12:20:22.632267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633788+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:22.633788+0000","last_peered":"2024-05-09T12:20:22.633788+0000","last_clean":"2024-05-09T12:20:22.633788+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:22.633788+0000","last_undegraded":"2024-05-09T12:20:22.633788+0000","last_fullsized":"2024-05-09T12:20:22.633788+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960218+0000","last_change":"2024-05-09T12:20:21.636481+0000","last_active":"2024-05-09T12:20:22.960218+0000","last_peered":"2024-05-09T12:20:22.960218+0000","last_clean":"2024-05-09T12:20:22.960218+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:20:22.960218+0000","last_undegraded":"2024-05-09T12:20:22.960218+0000","last_fullsized":"2024-05-09T12:20:22.960218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632105+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:20:22.632105+0000","last_peered":"2024-05-09T12:20:22.632105+0000","last_clean":"2024-05-09T12:20:22.632105+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:20:22.632105+0000","last_undegraded":"2024-05-09T12:20:22.632105+0000","last_fullsized":"2024-05-09T12:20:22.632105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633121+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:22.633121+0000","last_peered":"2024-05-09T12:20:22.633121+0000","last_clean":"2024-05-09T12:20:22.633121+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:22.633121+0000","last_undegraded":"2024-05-09T12:20:22.633121+0000","last_fullsized":"2024-05-09T12:20:22.633121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961013+0000","last_change":"2024-05-09T12:20:21.641170+0000","last_active":"2024-05-09T12:20:22.961013+0000","last_peered":"2024-05-09T12:20:22.961013+0000","last_clean":"2024-05-09T12:20:22.961013+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:20:22.961013+0000","last_undegraded":"2024-05-09T12:20:22.961013+0000","last_fullsized":"2024-05-09T12:20:22.961013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633653+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:20:22.633653+0000","last_peered":"2024-05-09T12:20:22.633653+0000","last_clean":"2024-05-09T12:20:22.633653+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:20:22.633653+0000","last_undegraded":"2024-05-09T12:20:22.633653+0000","last_fullsized":"2024-05-09T12:20:22.633653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633735+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:22.633735+0000","last_peered":"2024-05-09T12:20:22.633735+0000","last_clean":"2024-05-09T12:20:22.633735+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:22.633735+0000","last_undegraded":"2024-05-09T12:20:22.633735+0000","last_fullsized":"2024-05-09T12:20:22.633735+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631463+0000","last_change":"2024-05-09T12:20:21.630541+0000","last_active":"2024-05-09T12:20:22.631463+0000","last_peered":"2024-05-09T12:20:22.631463+0000","last_clean":"2024-05-09T12:20:22.631463+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:20:22.631463+0000","last_undegraded":"2024-05-09T12:20:22.631463+0000","last_fullsized":"2024-05-09T12:20:22.631463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633063+0000","last_change":"2024-05-09T12:20:21.630924+0000","last_active":"2024-05-09T12:20:22.633063+0000","last_peered":"2024-05-09T12:20:22.633063+0000","last_clean":"2024-05-09T12:20:22.633063+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:20:22.633063+0000","last_undegraded":"2024-05-09T12:20:22.633063+0000","last_fullsized":"2024-05-09T12:20:22.633063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633061+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:20:22.633061+0000","last_peered":"2024-05-09T12:20:22.633061+0000","last_clean":"2024-05-09T12:20:22.633061+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:20:22.633061+0000","last_undegraded":"2024-05-09T12:20:22.633061+0000","last_fullsized":"2024-05-09T12:20:22.633061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631908+0000","last_change":"2024-05-09T12:20:21.635202+0000","last_active":"2024-05-09T12:20:22.631908+0000","last_peered":"2024-05-09T12:20:22.631908+0000","last_clean":"2024-05-09T12:20:22.631908+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:20:22.631908+0000","last_undegraded":"2024-05-09T12:20:22.631908+0000","last_fullsized":"2024-05-09T12:20:22.631908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633873+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:20:22.633873+0000","last_peered":"2024-05-09T12:20:22.633873+0000","last_clean":"2024-05-09T12:20:22.633873+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:20:22.633873+0000","last_undegraded":"2024-05-09T12:20:22.633873+0000","last_fullsized":"2024-05-09T12:20:22.633873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633713+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:20:22.633713+0000","last_peered":"2024-05-09T12:20:22.633713+0000","last_clean":"2024-05-09T12:20:22.633713+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:20:22.633713+0000","last_undegraded":"2024-05-09T12:20:22.633713+0000","last_fullsized":"2024-05-09T12:20:22.633713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960371+0000","last_change":"2024-05-09T12:20:21.633256+0000","last_active":"2024-05-09T12:20:22.960371+0000","last_peered":"2024-05-09T12:20:22.960371+0000","last_clean":"2024-05-09T12:20:22.960371+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:20:22.960371+0000","last_undegraded":"2024-05-09T12:20:22.960371+0000","last_fullsized":"2024-05-09T12:20:22.960371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960984+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:20:22.960984+0000","last_peered":"2024-05-09T12:20:22.960984+0000","last_clean":"2024-05-09T12:20:22.960984+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:20:22.960984+0000","last_undegraded":"2024-05-09T12:20:22.960984+0000","last_fullsized":"2024-05-09T12:20:22.960984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631089+0000","last_change":"2024-05-09T12:20:21.635653+0000","last_active":"2024-05-09T12:20:22.631089+0000","last_peered":"2024-05-09T12:20:22.631089+0000","last_clean":"2024-05-09T12:20:22.631089+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:20:22.631089+0000","last_undegraded":"2024-05-09T12:20:22.631089+0000","last_fullsized":"2024-05-09T12:20:22.631089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633343+0000","last_change":"2024-05-09T12:20:21.644065+0000","last_active":"2024-05-09T12:20:22.633343+0000","last_peered":"2024-05-09T12:20:22.633343+0000","last_clean":"2024-05-09T12:20:22.633343+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:20:22.633343+0000","last_undegraded":"2024-05-09T12:20:22.633343+0000","last_fullsized":"2024-05-09T12:20:22.633343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:33.210315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631220+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:20:22.631220+0000","last_peered":"2024-05-09T12:20:22.631220+0000","last_clean":"2024-05-09T12:20:22.631220+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:20:22.631220+0000","last_undegraded":"2024-05-09T12:20:22.631220+0000","last_fullsized":"2024-05-09T12:20:22.631220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960567+0000","last_change":"2024-05-09T12:20:21.633601+0000","last_active":"2024-05-09T12:20:22.960567+0000","last_peered":"2024-05-09T12:20:22.960567+0000","last_clean":"2024-05-09T12:20:22.960567+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:20:22.960567+0000","last_undegraded":"2024-05-09T12:20:22.960567+0000","last_fullsized":"2024-05-09T12:20:22.960567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631280+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:20:22.631280+0000","last_peered":"2024-05-09T12:20:22.631280+0000","last_clean":"2024-05-09T12:20:22.631280+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:20:22.631280+0000","last_undegraded":"2024-05-09T12:20:22.631280+0000","last_fullsized":"2024-05-09T12:20:22.631280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960921+0000","last_change":"2024-05-09T12:20:21.638359+0000","last_active":"2024-05-09T12:20:22.960921+0000","last_peered":"2024-05-09T12:20:22.960921+0000","last_clean":"2024-05-09T12:20:22.960921+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:20:22.960921+0000","last_undegraded":"2024-05-09T12:20:22.960921+0000","last_fullsized":"2024-05-09T12:20:22.960921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632563+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:20:22.632563+0000","last_peered":"2024-05-09T12:20:22.632563+0000","last_clean":"2024-05-09T12:20:22.632563+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:20:22.632563+0000","last_undegraded":"2024-05-09T12:20:22.632563+0000","last_fullsized":"2024-05-09T12:20:22.632563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631862+0000","last_change":"2024-05-09T12:20:21.634182+0000","last_active":"2024-05-09T12:20:22.631862+0000","last_peered":"2024-05-09T12:20:22.631862+0000","last_clean":"2024-05-09T12:20:22.631862+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:20:22.631862+0000","last_undegraded":"2024-05-09T12:20:22.631862+0000","last_fullsized":"2024-05-09T12:20:22.631862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961067+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:20:22.961067+0000","last_peered":"2024-05-09T12:20:22.961067+0000","last_clean":"2024-05-09T12:20:22.961067+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:20:22.961067+0000","last_undegraded":"2024-05-09T12:20:22.961067+0000","last_fullsized":"2024-05-09T12:20:22.961067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633289+0000","last_change":"2024-05-09T12:20:21.638295+0000","last_active":"2024-05-09T12:20:22.633289+0000","last_peered":"2024-05-09T12:20:22.633289+0000","last_clean":"2024-05-09T12:20:22.633289+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:20:22.633289+0000","last_undegraded":"2024-05-09T12:20:22.633289+0000","last_fullsized":"2024-05-09T12:20:22.633289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632470+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:20:22.632470+0000","last_peered":"2024-05-09T12:20:22.632470+0000","last_clean":"2024-05-09T12:20:22.632470+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:20:22.632470+0000","last_undegraded":"2024-05-09T12:20:22.632470+0000","last_fullsized":"2024-05-09T12:20:22.632470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632133+0000","last_change":"2024-05-09T12:20:21.642394+0000","last_active":"2024-05-09T12:20:22.632133+0000","last_peered":"2024-05-09T12:20:22.632133+0000","last_clean":"2024-05-09T12:20:22.632133+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:20:22.632133+0000","last_undegraded":"2024-05-09T12:20:22.632133+0000","last_fullsized":"2024-05-09T12:20:22.632133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633690+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:20:22.633690+0000","last_peered":"2024-05-09T12:20:22.633690+0000","last_clean":"2024-05-09T12:20:22.633690+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:20:22.633690+0000","last_undegraded":"2024-05-09T12:20:22.633690+0000","last_fullsized":"2024-05-09T12:20:22.633690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960335+0000","last_change":"2024-05-09T12:20:21.634325+0000","last_active":"2024-05-09T12:20:22.960335+0000","last_peered":"2024-05-09T12:20:22.960335+0000","last_clean":"2024-05-09T12:20:22.960335+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:20:22.960335+0000","last_undegraded":"2024-05-09T12:20:22.960335+0000","last_fullsized":"2024-05-09T12:20:22.960335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960858+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:20:22.960858+0000","last_peered":"2024-05-09T12:20:22.960858+0000","last_clean":"2024-05-09T12:20:22.960858+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:20:22.960858+0000","last_undegraded":"2024-05-09T12:20:22.960858+0000","last_fullsized":"2024-05-09T12:20:22.960858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631969+0000","last_change":"2024-05-09T12:20:21.638597+0000","last_active":"2024-05-09T12:20:22.631969+0000","last_peered":"2024-05-09T12:20:22.631969+0000","last_clean":"2024-05-09T12:20:22.631969+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:20:22.631969+0000","last_undegraded":"2024-05-09T12:20:22.631969+0000","last_fullsized":"2024-05-09T12:20:22.631969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960843+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:20:22.960843+0000","last_peered":"2024-05-09T12:20:22.960843+0000","last_clean":"2024-05-09T12:20:22.960843+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:20:22.960843+0000","last_undegraded":"2024-05-09T12:20:22.960843+0000","last_fullsized":"2024-05-09T12:20:22.960843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":646638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":55708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":644318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":54692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:29.369 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T12:20:29.369 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T12:20:29.369 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T12:20:29.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T12:20:29.370 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.506+0000 7f081d866640 1 Processor -- start 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.506+0000 7f081d866640 1 -- start start 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f081d866640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 0x7f0818137a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f081d866640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f081806c0d0 0x7f081806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f081d866640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0818137f60 con 0x7f081806ca10 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f081d866640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f0818072430 con 0x7f081806c0d0 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f081d866640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0818073bc0 con 0x7f0818137640 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f08177fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f081806ca10 0x7f0818141880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37124/0 (socket says 172.21.15.135:37124) 2024-05-09T12:20:29.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f08177fe640 1 -- 172.21.15.135:0/1193547513 learned_addr learned my addr 172.21.15.135:0/1193547513 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f08167fc640 1 --2- 172.21.15.135:0/1193547513 >> v2:172.21.15.160:3300/0 conn(0x7f081806c0d0 0x7f081806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f0816ffd640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 0x7f0818137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043261317 0 0) 0x7f0810001110 con 0x7f081806ca10 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0804003520 con 0x7f081806ca10 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.507+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 381803469 0 0) 0x7f0804003520 con 0x7f081806ca10 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f08167fc640 1 -- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 msgr2=0x7f0818137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f08167fc640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 0x7f0818137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f08167fc640 1 -- 172.21.15.135:0/1193547513 >> v1:172.21.15.135:6789/0 conn(0x7f081806ca10 legacy=0x7f0818141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f08167fc640 1 -- 172.21.15.135:0/1193547513 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0818070b40 con 0x7f081806c0d0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f0816ffd640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 0x7f0818137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f08167fc640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806c0d0 0x7f081806c4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f08000097a0 tx=0x7f080002b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be95540a812e7b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.508+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800037070 con 0x7f081806c0d0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0800030510 con 0x7f081806c0d0 2024-05-09T12:20:29.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f0815ffb640 1 -- 172.21.15.135:0/1193547513 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080002be60 con 0x7f081806c0d0 2024-05-09T12:20:29.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 -- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806c0d0 msgr2=0x7f081806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806c0d0 0x7f081806c4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f08000097a0 tx=0x7f080002b660 comp rx=0 tx=0).stop 2024-05-09T12:20:29.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 -- 172.21.15.135:0/1193547513 shutdown_connections 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806c0d0 0x7f081806c4d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 --2- 172.21.15.135:0/1193547513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0818137640 0x7f0818137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 -- 172.21.15.135:0/1193547513 >> 172.21.15.135:0/1193547513 conn(0x7f08180aba90 msgr2=0x7f08180abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 -- 172.21.15.135:0/1193547513 shutdown_connections 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.509+0000 7f081d866640 1 -- 172.21.15.135:0/1193547513 wait complete. 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.510+0000 7f081d866640 1 Processor -- start 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.510+0000 7f081d866640 1 -- start start 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f081806c0d0 0x7f08181ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806ca10 0x7f08181cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0818072a40 con 0x7f0818137640 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0818073470 con 0x7f081806ca10 2024-05-09T12:20:29.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0818072fe0 con 0x7f081806c0d0 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40988/0 (socket says 172.21.15.135:40988) 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 -- 172.21.15.135:0/3396919014 learned_addr learned my addr 172.21.15.135:0/3396919014 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08167fc640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806ca10 0x7f08181cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f0816ffd640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f081806c0d0 0x7f08181ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 -- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f081806c0d0 msgr2=0x7f08181ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f081806c0d0 0x7f08181ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 -- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806ca10 msgr2=0x7f08181cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806ca10 0x7f08181cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 -- 172.21.15.135:0/3396919014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08181cc570 con 0x7f0818137640 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f08177fe640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f081000c600 tx=0x7f081000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810005ce0 con 0x7f0818137640 2024-05-09T12:20:29.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0810007070 con 0x7f0818137640 2024-05-09T12:20:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810007460 con 0x7f0818137640 2024-05-09T12:20:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08181cc810 con 0x7f0818137640 2024-05-09T12:20:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.511+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08180a3f80 con 0x7f0818137640 2024-05-09T12:20:29.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.512+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08180a8720 con 0x7f0818137640 2024-05-09T12:20:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.513+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0810007600 con 0x7f0818137640 2024-05-09T12:20:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.513+0000 7f080ffff640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 0x7f07f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.514+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f0810096cc0 con 0x7f0818137640 2024-05-09T12:20:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.514+0000 7f0816ffd640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 0x7f07f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.514+0000 7f0816ffd640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 0x7f07f8078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0808009bd0 tx=0x7f080800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.518+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0818137f60 con 0x7f0818137640 2024-05-09T12:20:29.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.752+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f08180508d0 con 0x7f0818137640 2024-05-09T12:20:29.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.755+0000 7f080ffff640 1 -- 172.21.15.135:0/3396919014 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189525 (secure 0 0 0) 0x7f08100605c0 con 0x7f0818137640 2024-05-09T12:20:29.755 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.757+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 msgr2=0x7f07f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.757+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 0x7f07f8078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0808009bd0 tx=0x7f080800b040 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 msgr2=0x7f08181d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f081000c600 tx=0x7f081000cac0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 shutdown_connections 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f07f80762d0 0x7f07f8078790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0818137640 0x7f08181d0020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f081806ca10 0x7f08181cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 --2- 172.21.15.135:0/3396919014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f081806c0d0 0x7f08181ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 >> 172.21.15.135:0/3396919014 conn(0x7f08180aba90 msgr2=0x7f08181364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:29.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 shutdown_connections 2024-05-09T12:20:29.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.758+0000 7f081d866640 1 -- 172.21.15.135:0/3396919014 wait complete. 2024-05-09T12:20:29.768 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":185233510},{"type":"v1","addr":"172.21.15.135:6817","nonce":185233510}]},"active_addr":"172.21.15.135:6817/185233510","active_change":"2024-05-09T12:20:09.367731+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2030150445}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3093888990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2223479942}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3443263263}]}]} 2024-05-09T12:20:29.772 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T12:20:29.772 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T12:20:29.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:29.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.872+0000 7f4e7bc66640 1 Processor -- start 2024-05-09T12:20:29.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 -- start start 2024-05-09T12:20:29.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4e741398c0 0x7f4e74139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4e7413c7e0 0x7f4e7413cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413d1b0 0x7f4e74143b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4e74139270 con 0x7f4e741398c0 2024-05-09T12:20:29.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7409f490 con 0x7f4e7413c7e0 2024-05-09T12:20:29.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.873+0000 7f4e7bc66640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7413d620 con 0x7f4e7413d1b0 2024-05-09T12:20:29.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4e741398c0 0x7f4e74139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4e741398c0 0x7f4e74139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41002/0 (socket says 172.21.15.135:41002) 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 -- 172.21.15.135:0/1074860932 learned_addr learned my addr 172.21.15.135:0/1074860932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79201640 1 --2- 172.21.15.135:0/1074860932 >> v2:172.21.15.160:3300/0 conn(0x7f4e7413c7e0 0x7f4e7413cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e7a203640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413d1b0 0x7f4e74143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 -- 172.21.15.135:0/1074860932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413d1b0 msgr2=0x7f4e74143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413d1b0 0x7f4e74143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 -- 172.21.15.135:0/1074860932 >> v2:172.21.15.160:3300/0 conn(0x7f4e7413c7e0 msgr2=0x7f4e7413cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 --2- 172.21.15.135:0/1074860932 >> v2:172.21.15.160:3300/0 conn(0x7f4e7413c7e0 0x7f4e7413cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.874+0000 7f4e79a02640 1 -- 172.21.15.135:0/1074860932 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7413a1e0 con 0x7f4e741398c0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e79a02640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e74139ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e7406c690 tx=0x7f4e7002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7000bd3ec293ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e78a00640 1 -- 172.21.15.135:0/1074860932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70038070 con 0x7f4e741398c0 2024-05-09T12:20:29.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e78a00640 1 -- 172.21.15.135:0/1074860932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70031740 con 0x7f4e741398c0 2024-05-09T12:20:29.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e78a00640 1 -- 172.21.15.135:0/1074860932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7002f050 con 0x7f4e741398c0 2024-05-09T12:20:29.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 -- 172.21.15.135:0/1074860932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 msgr2=0x7f4e74139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e74139ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e7406c690 tx=0x7f4e7002b7e0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 -- 172.21.15.135:0/1074860932 shutdown_connections 2024-05-09T12:20:29.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413d1b0 0x7f4e74143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/1074860932 >> v2:172.21.15.160:3300/0 conn(0x7f4e7413c7e0 0x7f4e7413cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/1074860932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e74139ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.875+0000 7f4e7bc66640 1 -- 172.21.15.135:0/1074860932 >> 172.21.15.135:0/1074860932 conn(0x7f4e740ab940 msgr2=0x7f4e740abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.876+0000 7f4e7bc66640 1 -- 172.21.15.135:0/1074860932 shutdown_connections 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.876+0000 7f4e7bc66640 1 -- 172.21.15.135:0/1074860932 wait complete. 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 Processor -- start 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 -- start start 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413c7e0 0x7f4e741d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e7413d1b0 0x7f4e741d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e740a90c0 con 0x7f4e741398c0 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7409d2a0 con 0x7f4e7413d1b0 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7bc66640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7409de80 con 0x7f4e7413c7e0 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41006/0 (socket says 172.21.15.135:41006) 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 -- 172.21.15.135:0/2706343053 learned_addr learned my addr 172.21.15.135:0/2706343053 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 -- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413c7e0 msgr2=0x7f4e741d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e7a203640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e7413d1b0 0x7f4e741d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413c7e0 0x7f4e741d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 -- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e7413d1b0 msgr2=0x7f4e741d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e7413d1b0 0x7f4e741d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.877+0000 7f4e79a02640 1 -- 172.21.15.135:0/2706343053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e740a3590 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e79a02640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e7002b820 tx=0x7f4e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70042070 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e70031e80 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70038040 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e740a4460 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.878+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e740a3b30 con 0x7f4e741398c0 2024-05-09T12:20:29.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.879+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e740508d0 con 0x7f4e741398c0 2024-05-09T12:20:29.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.879+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e70045070 con 0x7f4e741398c0 2024-05-09T12:20:29.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.880+0000 7f4e6a7fc640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 0x7f4e58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:29.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.880+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f4e700b8c70 con 0x7f4e741398c0 2024-05-09T12:20:29.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.880+0000 7f4e79201640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 0x7f4e58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:29.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.880+0000 7f4e79201640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 0x7f4e58078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e740a4900 tx=0x7f4e64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:29.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:29.884+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e7004c030 con 0x7f4e741398c0 2024-05-09T12:20:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.065+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7409cc60 con 0x7f4e741398c0 2024-05-09T12:20:30.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.066+0000 7f4e6a7fc640 1 -- 172.21.15.135:0/2706343053 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+13581 (secure 0 0 0) 0x7f4e70082bc0 con 0x7f4e741398c0 2024-05-09T12:20:30.065 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:30.065 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:22.622854+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:30.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 msgr2=0x7f4e58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 0x7f4e58078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e740a4900 tx=0x7f4e64008040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 msgr2=0x7f4e741d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e7002b820 tx=0x7f4e700046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 shutdown_connections 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4e580762d0 0x7f4e58078790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e7413d1b0 0x7f4e741d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7413c7e0 0x7f4e741d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 --2- 172.21.15.135:0/2706343053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e741398c0 0x7f4e741d1cb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 >> 172.21.15.135:0/2706343053 conn(0x7f4e740ab940 msgr2=0x7f4e741371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 shutdown_connections 2024-05-09T12:20:30.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.068+0000 7f4e7bc66640 1 -- 172.21.15.135:0/2706343053 wait complete. 2024-05-09T12:20:30.079 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T12:20:30.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:30.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 Processor -- start 2024-05-09T12:20:30.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 -- start start 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f5c073440 0x7f0f5c139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c06d870 con 0x7f0f5c13cd10 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c072890 con 0x7f0f5c139860 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f63ad4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c073d50 con 0x7f0f5c073440 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f6106f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f5c073440 0x7f0f5c139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f6106f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f5c073440 0x7f0f5c139c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41022/0 (socket says 172.21.15.135:41022) 2024-05-09T12:20:30.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f6106f640 1 -- 172.21.15.135:0/3927711897 learned_addr learned my addr 172.21.15.135:0/3927711897 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.180+0000 7f0f62071640 1 --1- 172.21.15.135:0/3927711897 >> v1:172.21.15.135:6789/0 conn(0x7f0f5c13cd10 0x7f0f5c144980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37138/0 (socket says 172.21.15.135:37138) 2024-05-09T12:20:30.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.181+0000 7f0f6106f640 1 -- 172.21.15.135:0/3927711897 >> v1:172.21.15.160:6789/0 conn(0x7f0f5c139860 legacy=0x7f0f5c13c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.181+0000 7f0f6106f640 1 -- 172.21.15.135:0/3927711897 >> v1:172.21.15.135:6789/0 conn(0x7f0f5c13cd10 legacy=0x7f0f5c144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.181+0000 7f0f6106f640 1 -- 172.21.15.135:0/3927711897 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c073a90 con 0x7f0f5c073440 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.181+0000 7f0f6106f640 1 --2- 172.21.15.135:0/3927711897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c073440 0x7f0f5c139c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009870 tx=0x7f0f5802b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bd3ffe82747269 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f6086e640 1 -- 172.21.15.135:0/3927711897 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58037070 con 0x7f0f5c073440 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f6086e640 1 -- 172.21.15.135:0/3927711897 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f58030710 con 0x7f0f5c073440 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f6086e640 1 -- 172.21.15.135:0/3927711897 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58030ae0 con 0x7f0f5c073440 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 -- 172.21.15.135:0/3927711897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c073440 msgr2=0x7f0f5c139c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/3927711897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c073440 0x7f0f5c139c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009870 tx=0x7f0f5802b740 comp rx=0 tx=0).stop 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 -- 172.21.15.135:0/3927711897 shutdown_connections 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/3927711897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c073440 0x7f0f5c139c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 -- 172.21.15.135:0/3927711897 >> 172.21.15.135:0/3927711897 conn(0x7f0f5c0ac9c0 msgr2=0x7f0f5c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 -- 172.21.15.135:0/3927711897 shutdown_connections 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.182+0000 7f0f63ad4640 1 -- 172.21.15.135:0/3927711897 wait complete. 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.183+0000 7f0f63ad4640 1 Processor -- start 2024-05-09T12:20:30.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.183+0000 7f0f63ad4640 1 -- start start 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f5c073440 0x7f0f5c1d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c139860 0x7f0f5c1d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c0747c0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c072e60 con 0x7f0f5c139860 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c074940 con 0x7f0f5c073440 2024-05-09T12:20:30.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41026/0 (socket says 172.21.15.135:41026) 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 -- 172.21.15.135:0/2336183745 learned_addr learned my addr 172.21.15.135:0/2336183745 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f61870640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f5c073440 0x7f0f5c1d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f6106f640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c139860 0x7f0f5c1d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 -- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f5c073440 msgr2=0x7f0f5c1d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f5c073440 0x7f0f5c1d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 -- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c139860 msgr2=0x7f0f5c1d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c139860 0x7f0f5c1d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 -- 172.21.15.135:0/2336183745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c0a3b30 con 0x7f0f5c13cd10 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f62071640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400caa0 tx=0x7f0f5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54018070 con 0x7f0f5c13cd10 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5400a6d0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c0a2d20 con 0x7f0f5c13cd10 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400ab40 con 0x7f0f5c13cd10 2024-05-09T12:20:30.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.184+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c0a4ef0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.185+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c0508d0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.186+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f5401b070 con 0x7f0f5c13cd10 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.187+0000 7f0f4e7fc640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 0x7f0f40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.187+0000 7f0f61870640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 0x7f0f40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.187+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f0f54096760 con 0x7f0f5c13cd10 2024-05-09T12:20:30.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.187+0000 7f0f61870640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 0x7f0f40078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c13d460 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.191+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f540606b0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.372+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f5c06f060 con 0x7f0f5c13cd10 2024-05-09T12:20:30.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.373+0000 7f0f4e7fc640 1 -- 172.21.15.135:0/2336183745 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+13581 (secure 0 0 0) 0x7f0f5405ffb0 con 0x7f0f5c13cd10 2024-05-09T12:20:30.372 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:30.373 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:22.622854+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 msgr2=0x7f0f40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 0x7f0f40078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c13d460 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 msgr2=0x7f0f5c1d2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400caa0 tx=0x7f0f5400cf60 comp rx=0 tx=0).stop 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 shutdown_connections 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0f400762d0 0x7f0f40078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f5c13cd10 0x7f0f5c1d2af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0f5c139860 0x7f0f5c1d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 --2- 172.21.15.135:0/2336183745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f5c073440 0x7f0f5c1d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 >> 172.21.15.135:0/2336183745 conn(0x7f0f5c0ac9c0 msgr2=0x7f0f5c1c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 shutdown_connections 2024-05-09T12:20:30.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.375+0000 7f0f63ad4640 1 -- 172.21.15.135:0/2336183745 wait complete. 2024-05-09T12:20:30.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T12:20:30.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T12:20:30.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T12:20:30.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T12:20:30.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.494+0000 7fc4e3c66640 1 Processor -- start 2024-05-09T12:20:30.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.494+0000 7efd47f11640 1 Processor -- start 2024-05-09T12:20:30.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7fd51324c640 1 Processor -- start 2024-05-09T12:20:30.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7fd51324c640 1 -- start start 2024-05-09T12:20:30.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efd47f11640 1 -- start start 2024-05-09T12:20:30.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efed5aff640 1 Processor -- start 2024-05-09T12:20:30.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7fc4e3c66640 1 -- start start 2024-05-09T12:20:30.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efed5aff640 1 -- start start 2024-05-09T12:20:30.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7fd51324c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 0x7fd50c09e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7fd51324c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd50c13a5e0 0x7fd50c13aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efd47f11640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efd4013fa80 0x7efd40141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efd47f11640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4006ca80 con 0x7efd401397e0 2024-05-09T12:20:30.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efd47f11640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4006c3e0 con 0x7efd401423b0 2024-05-09T12:20:30.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.495+0000 7efd47f11640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7efd40139200 con 0x7efd4013fa80 2024-05-09T12:20:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efed5aff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efed00a5080 0x7efed0141f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efed5aff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed0139a40 con 0x7efed0136280 2024-05-09T12:20:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efed5aff640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed00a3b10 con 0x7efed0135ea0 2024-05-09T12:20:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efed5aff640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7efed00a38f0 con 0x7efed00a5080 2024-05-09T12:20:30.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e3c66640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4dc137680 0x7fc4dc137a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efeceffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7efed0136280 0x7efed0139330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37168/0 (socket says 172.21.15.135:37168) 2024-05-09T12:20:30.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efeceffd640 1 -- 172.21.15.135:0/3982676654 learned_addr learned my addr 172.21.15.135:0/3982676654 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd45cad640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7efd401397e0 0x7efd40139bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37152/0 (socket says 172.21.15.135:37152) 2024-05-09T12:20:30.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd45cad640 1 -- 172.21.15.135:0/1186819653 learned_addr learned my addr 172.21.15.135:0/1186819653 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd510fe8640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 0x7fd50c09e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e3c66640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc4dc13a3d0 0x7fc4dc13a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efecffff640 1 --2- 172.21.15.135:0/3982676654 >> v2:172.21.15.160:3300/0 conn(0x7efed00a5080 0x7efed0141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e3c66640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc09bc20 con 0x7fc4dc13adc0 2024-05-09T12:20:30.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e3c66640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc4dc09c700 con 0x7fc4dc137680 2024-05-09T12:20:30.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e3c66640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fc4dc074560 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd454ac640 1 --2- 172.21.15.135:0/1186819653 >> v2:172.21.15.135:3300/0 conn(0x7efd4013fa80 0x7efd40141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd510fe8640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 0x7fd50c09e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51276/0 (socket says 172.21.15.135:51276) 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd50bfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd50c13a5e0 0x7fd50c13aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546407087 0 0) 0x7efd4006c3e0 con 0x7efd401423b0 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd50bfff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd50c13a5e0 0x7fd50c13aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41038/0 (socket says 172.21.15.135:41038) 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd50bfff640 1 -- 172.21.15.135:0/1584798464 learned_addr learned my addr 172.21.15.135:0/1584798464 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c09c7c0 con 0x7fd50c13af80 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e2203640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc4dc13adc0 0x7fc4dc141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37178/0 (socket says 172.21.15.135:37178) 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e2203640 1 -- 172.21.15.135:0/1648251969 learned_addr learned my addr 172.21.15.135:0/1648251969 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e1a02640 1 --2- 172.21.15.135:0/1648251969 >> v2:172.21.15.135:3300/0 conn(0x7fc4dc137680 0x7fc4dc137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fc4e1201640 1 --2- 172.21.15.135:0/1648251969 >> v2:172.21.15.160:3300/0 conn(0x7fc4dc13a3d0 0x7fc4dc13a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd2c003520 con 0x7efd401423b0 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152129614 0 0) 0x7efd3c001040 con 0x7efd401397e0 2024-05-09T12:20:30.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd4006c3e0 con 0x7efd401397e0 2024-05-09T12:20:30.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efecffff640 1 -- 172.21.15.135:0/3982676654 >> v1:172.21.15.160:6789/0 conn(0x7efed0135ea0 legacy=0x7efed0138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:30.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efece7fc640 1 -- 172.21.15.135:0/3982676654 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244626774 0 0) 0x7efed0139a40 con 0x7efed0136280 2024-05-09T12:20:30.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c074150 con 0x7fd50c13a5e0 2024-05-09T12:20:30.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c09f140 con 0x7fd50c09e340 2024-05-09T12:20:30.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efecffff640 1 -- 172.21.15.135:0/3982676654 >> v1:172.21.15.135:6789/0 conn(0x7efed0136280 legacy=0x7efed0139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efecffff640 1 -- 172.21.15.135:0/3982676654 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00a3f00 con 0x7efed00a5080 2024-05-09T12:20:30.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd454ac640 1 -- 172.21.15.135:0/1186819653 >> v1:172.21.15.160:6789/0 conn(0x7efd401423b0 legacy=0x7efd401447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd454ac640 1 -- 172.21.15.135:0/1186819653 >> v1:172.21.15.135:6789/0 conn(0x7efd401397e0 legacy=0x7efd40139bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.496+0000 7efd454ac640 1 -- 172.21.15.135:0/1186819653 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4009d3b0 con 0x7efd4013fa80 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fc4e1201640 1 -- 172.21.15.135:0/1648251969 >> v2:172.21.15.135:3300/0 conn(0x7fc4dc137680 msgr2=0x7fc4dc137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fc4e1201640 1 --2- 172.21.15.135:0/1648251969 >> v2:172.21.15.135:3300/0 conn(0x7fc4dc137680 0x7fc4dc137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fc4e1201640 1 -- 172.21.15.135:0/1648251969 >> v1:172.21.15.135:6789/0 conn(0x7fc4dc13adc0 legacy=0x7fc4dc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fc4e1201640 1 -- 172.21.15.135:0/1648251969 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc13b1f0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fd50bfff640 1 -- 172.21.15.135:0/1584798464 >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 msgr2=0x7fd50c09e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fd50bfff640 1 --2- 172.21.15.135:0/1584798464 >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 0x7fd50c09e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fd50bfff640 1 -- 172.21.15.135:0/1584798464 >> v1:172.21.15.135:6789/0 conn(0x7fd50c13af80 legacy=0x7fd50c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7fd50bfff640 1 -- 172.21.15.135:0/1584798464 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c09caa0 con 0x7fd50c13a5e0 2024-05-09T12:20:30.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7efecffff640 1 --2- 172.21.15.135:0/3982676654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed00a5080 0x7efed0141f70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec802cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5c51333a3f4058 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7efd454ac640 1 --2- 172.21.15.135:0/1186819653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40141e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd300097a0 tx=0x7efd3002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35004f587ab1f2bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.497+0000 7efece7fc640 1 -- 172.21.15.135:0/3982676654 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec803a070 con 0x7efed00a5080 2024-05-09T12:20:30.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efece7fc640 1 -- 172.21.15.135:0/3982676654 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec802dce0 con 0x7efed00a5080 2024-05-09T12:20:30.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fc4e1201640 1 --2- 172.21.15.135:0/1648251969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc13a880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc073fb0 tx=0x7fc4cc02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18446fe0890892f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efece7fc640 1 -- 172.21.15.135:0/3982676654 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8035660 con 0x7efed00a5080 2024-05-09T12:20:30.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fc4e0a00640 1 -- 172.21.15.135:0/1648251969 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc038070 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd300315a0 con 0x7efd4013fa80 2024-05-09T12:20:30.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30037070 con 0x7efd4013fa80 2024-05-09T12:20:30.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efd44cab640 1 -- 172.21.15.135:0/1186819653 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30031940 con 0x7efd4013fa80 2024-05-09T12:20:30.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fd50bfff640 1 --2- 172.21.15.135:0/1584798464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c13a5e0 0x7fd50c13aa40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0ad980 tx=0x7fd4f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2abc06ce920df81 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fc4e0a00640 1 -- 172.21.15.135:0/1648251969 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc031710 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fc4e0a00640 1 -- 172.21.15.135:0/1648251969 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc031ae0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fd50b7fe640 1 -- 172.21.15.135:0/1584798464 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8035020 con 0x7fd50c13a5e0 2024-05-09T12:20:30.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fd50b7fe640 1 -- 172.21.15.135:0/1584798464 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f8031870 con 0x7fd50c13a5e0 2024-05-09T12:20:30.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7fd50b7fe640 1 -- 172.21.15.135:0/1584798464 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8031c40 con 0x7fd50c13a5e0 2024-05-09T12:20:30.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efed5aff640 1 -- 172.21.15.135:0/3982676654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed00a5080 msgr2=0x7efed0141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.498+0000 7efed5aff640 1 --2- 172.21.15.135:0/3982676654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed00a5080 0x7efed0141f70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec802cf30 comp rx=0 tx=0).stop 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efed5aff640 1 -- 172.21.15.135:0/3982676654 shutdown_connections 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efed5aff640 1 --2- 172.21.15.135:0/3982676654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed00a5080 0x7efed0141f70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efed5aff640 1 -- 172.21.15.135:0/3982676654 >> 172.21.15.135:0/3982676654 conn(0x7efed00aaf90 msgr2=0x7efed00ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efed5aff640 1 -- 172.21.15.135:0/3982676654 shutdown_connections 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c13a5e0 msgr2=0x7fd50c13aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 --2- 172.21.15.135:0/1584798464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c13a5e0 0x7fd50c13aa40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0ad980 tx=0x7fd4f802b910 comp rx=0 tx=0).stop 2024-05-09T12:20:30.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 -- 172.21.15.135:0/1186819653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 msgr2=0x7efd40141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 --2- 172.21.15.135:0/1186819653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40141e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd300097a0 tx=0x7efd3002b840 comp rx=0 tx=0).stop 2024-05-09T12:20:30.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 -- 172.21.15.135:0/1648251969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 msgr2=0x7fc4dc13a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 --2- 172.21.15.135:0/1648251969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc13a880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc073fb0 tx=0x7fc4cc02b7b0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efed5aff640 1 -- 172.21.15.135:0/3982676654 wait complete. 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 shutdown_connections 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 --2- 172.21.15.135:0/1584798464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c13a5e0 0x7fd50c13aa40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 --2- 172.21.15.135:0/1584798464 >> v2:172.21.15.160:3300/0 conn(0x7fd50c09e340 0x7fd50c09e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 >> 172.21.15.135:0/1584798464 conn(0x7fd50c0acb30 msgr2=0x7fd50c0acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 shutdown_connections 2024-05-09T12:20:30.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 -- 172.21.15.135:0/1648251969 shutdown_connections 2024-05-09T12:20:30.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fd51324c640 1 -- 172.21.15.135:0/1584798464 wait complete. 2024-05-09T12:20:30.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 --2- 172.21.15.135:0/1648251969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc13a880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 --2- 172.21.15.135:0/1648251969 >> v2:172.21.15.135:3300/0 conn(0x7fc4dc137680 0x7fc4dc137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 -- 172.21.15.135:0/1648251969 >> 172.21.15.135:0/1648251969 conn(0x7fc4dc0aca30 msgr2=0x7fc4dc0ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 -- 172.21.15.135:0/1186819653 shutdown_connections 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 --2- 172.21.15.135:0/1186819653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40141e70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 -- 172.21.15.135:0/1186819653 >> 172.21.15.135:0/1186819653 conn(0x7efd400ab940 msgr2=0x7efd400abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 -- 172.21.15.135:0/1186819653 shutdown_connections 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 -- 172.21.15.135:0/1648251969 shutdown_connections 2024-05-09T12:20:30.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7fc4e3c66640 1 -- 172.21.15.135:0/1648251969 wait complete. 2024-05-09T12:20:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.499+0000 7efd47f11640 1 -- 172.21.15.135:0/1186819653 wait complete. 2024-05-09T12:20:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7efed5aff640 1 Processor -- start 2024-05-09T12:20:30.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7efd47f11640 1 Processor -- start 2024-05-09T12:20:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7efed5aff640 1 -- start start 2024-05-09T12:20:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7efd47f11640 1 -- start start 2024-05-09T12:20:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7fd51324c640 1 Processor -- start 2024-05-09T12:20:30.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7fd51324c640 1 -- start start 2024-05-09T12:20:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.500+0000 7fc4e3c66640 1 Processor -- start 2024-05-09T12:20:30.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fc4e3c66640 1 -- start start 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efed00a5080 0x7efed012fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed0135ea0 0x7efed01300e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 0x7efed006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efed00a2180 con 0x7efed0136280 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efed00a5490 con 0x7efed0135ea0 2024-05-09T12:20:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efed5aff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efed00a2dc0 con 0x7efed00a5080 2024-05-09T12:20:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd401397e0 0x7efd401325e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40132b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd401423b0 0x7efd401d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 0x7efed006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 0x7efed006fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41070/0 (socket says 172.21.15.135:41070) 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 -- 172.21.15.135:0/2004130387 learned_addr learned my addr 172.21.15.135:0/2004130387 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40132b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd400a0350 con 0x7efd4013fa80 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd400a9150 con 0x7efd401397e0 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd47f11640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efd4009ff00 con 0x7efd401423b0 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40132b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41078/0 (socket says 172.21.15.135:41078) 2024-05-09T12:20:30.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 -- 172.21.15.135:0/4205594834 learned_addr learned my addr 172.21.15.135:0/4205594834 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efeceffd640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed0135ea0 0x7efed01300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecf7fe640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efed00a5080 0x7efed012fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd464ae640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd401423b0 0x7efd401d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd45cad640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd401397e0 0x7efd401325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fd51324c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 0x7fd50c122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fc4e3c66640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4dc137680 0x7fc4dc1354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 -- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efed00a5080 msgr2=0x7efed012fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efed00a5080 0x7efed012fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fc4e3c66640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc135a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 -- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed0135ea0 msgr2=0x7efed01300e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed0135ea0 0x7efed01300e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 -- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd401423b0 msgr2=0x7efd401d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd401423b0 0x7efd401d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 -- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd401397e0 msgr2=0x7efd401325e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd401397e0 0x7efd401325e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd454ac640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd40141b90 con 0x7efd4013fa80 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efd45cad640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd401397e0 0x7efd401325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fd510fe8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 0x7fd50c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efecffff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00a3430 con 0x7efed0136280 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7efeceffd640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed0135ea0 0x7efed01300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fc4e3c66640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4dc13adc0 0x7fc4dc1cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.501+0000 7fd510fe8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 0x7fd50c122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41090/0 (socket says 172.21.15.135:41090) 2024-05-09T12:20:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd454ac640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40132b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd30000c00 tx=0x7efd300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e3c66640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc137fa0 con 0x7fc4dc13adc0 2024-05-09T12:20:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc135a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 -- 172.21.15.135:0/976664067 learned_addr learned my addr 172.21.15.135:0/976664067 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e3c66640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc09b2d0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc135a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51330/0 (socket says 172.21.15.135:51330) 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 -- 172.21.15.135:0/728507200 learned_addr learned my addr 172.21.15.135:0/728507200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efecffff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 0x7efed006fef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e3c66640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc4dc09ade0 con 0x7fc4dc137680 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1a02640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4dc137680 0x7fc4dc1354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e2203640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4dc13adc0 0x7fc4dc1cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd51324c640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c13a5e0 0x7fd50c1234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30032630 con 0x7efd4013fa80 2024-05-09T12:20:30.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd51324c640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd50c13af80 0x7fd50c123a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c09c500 con 0x7fd50c09e340 2024-05-09T12:20:30.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c09d680 con 0x7fd50c13a5e0 2024-05-09T12:20:30.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c09b520 con 0x7fd50c13af80 2024-05-09T12:20:30.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd300327d0 con 0x7efd4013fa80 2024-05-09T12:20:30.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec803a040 con 0x7efed0136280 2024-05-09T12:20:30.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30032b80 con 0x7efd4013fa80 2024-05-09T12:20:30.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed0072880 con 0x7efed0136280 2024-05-09T12:20:30.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd400a0ae0 con 0x7efd4013fa80 2024-05-09T12:20:30.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd50bfff640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c13a5e0 0x7fd50c1234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed0073030 con 0x7efed0136280 2024-05-09T12:20:30.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd5117e9640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd50c13af80 0x7fd50c123a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 -- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4dc137680 msgr2=0x7fc4dc1354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4dc137680 0x7fc4dc1354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 -- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4dc13adc0 msgr2=0x7fc4dc1cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4dc13adc0 0x7fc4dc1cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fc4e1201640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc0a7470 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd400a07b0 con 0x7efd4013fa80 2024-05-09T12:20:30.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec802dae0 con 0x7efed0136280 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 -- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd50c13af80 msgr2=0x7fd50c123a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd50c13af80 0x7fd50c123a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 -- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c13a5e0 msgr2=0x7fd50c1234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd50c13a5e0 0x7fd50c1234e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.502+0000 7fd510fe8640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c1252a0 con 0x7fd50c09e340 2024-05-09T12:20:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fd510fe8640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 0x7fd50c122fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd50000d800 tx=0x7fd50000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8035660 con 0x7efed0136280 2024-05-09T12:20:30.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4e1201640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc135a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd400508d0 con 0x7efd4013fa80 2024-05-09T12:20:30.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efeb0000f80 con 0x7efed0136280 2024-05-09T12:20:30.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc042070 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc033bc0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc038040 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4e3c66640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc0a8630 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500018020 con 0x7fd50c09e340 2024-05-09T12:20:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fc4e3c66640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc0a79a0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.503+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1256f0 con 0x7fd50c09e340 2024-05-09T12:20:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.504+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c125c90 con 0x7fd50c09e340 2024-05-09T12:20:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.504+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd50c0508d0 con 0x7fd50c09e340 2024-05-09T12:20:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.504+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd500009660 con 0x7fd50c09e340 2024-05-09T12:20:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.504+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd3004e430 con 0x7efd4013fa80 2024-05-09T12:20:30.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.504+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500018020 con 0x7fd50c09e340 2024-05-09T12:20:30.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efec8045020 con 0x7efed0136280 2024-05-09T12:20:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd367fc640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efd24076320 0x7efd240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7efd3002f030 con 0x7efd4013fa80 2024-05-09T12:20:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd45cad640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efd24076320 0x7efd240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4dc0a97b0 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd367fc640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7efd2407df80 0x7efd240803c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd30047ec0 con 0x7efd2407df80 2024-05-09T12:20:30.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.505+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efd300b94f0 con 0x7efd4013fa80 2024-05-09T12:20:30.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeb7fff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efebc0762d0 0x7efebc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efd464ae640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7efd2407df80 0x7efd240803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efecf7fe640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efebc0762d0 0x7efebc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7efec80b9800 con 0x7efed0136280 2024-05-09T12:20:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efd45cad640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efd24076320 0x7efd240787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005880 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeb7fff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7efebc07df30 0x7efebc080370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efec80020b0 con 0x7efebc07df30 2024-05-09T12:20:30.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efec80b9bf0 con 0x7efed0136280 2024-05-09T12:20:30.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efd464ae640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7efd2407df80 0x7efd240803c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efeceffd640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7efebc07df30 0x7efebc080370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7efecf7fe640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efebc0762d0 0x7efebc078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efec00017c0 tx=0x7efec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.506+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd50001b020 con 0x7fd50c09e340 2024-05-09T12:20:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc4cc03b070 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7efeceffd640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7efebc07df30 0x7efebc080370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5097fa640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd4f00764d0 0x7fd4f0078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc4c007a6e0 0x7fc4c007cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fd500097730 con 0x7fd50c09e340 2024-05-09T12:20:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== osd.2 v2:172.21.15.160:6800/2987975206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd30047ec0 con 0x7efd2407df80 2024-05-09T12:20:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd50bfff640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd4f00764d0 0x7fd4f0078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5097fa640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fd4f007e0c0 0x7fd4f0080500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd500015e50 con 0x7fd4f007e0c0 2024-05-09T12:20:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd500097b90 con 0x7fd50c09e340 2024-05-09T12:20:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fc4cc0b8e70 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fc4c00822d0 0x7fc4c0084710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4c0084de0 con 0x7fc4c00822d0 2024-05-09T12:20:30.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc4cc0b9300 con 0x7fc4dc13a3d0 2024-05-09T12:20:30.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fd5117e9640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fd4f007e0c0 0x7fd4f0080500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7fc4e2203640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fc4c00822d0 0x7fc4c0084710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.507+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== osd.3 v2:172.21.15.160:6808/2030310005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efec80020b0 con 0x7efebc07df30 2024-05-09T12:20:30.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.508+0000 7fd50bfff640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd4f00764d0 0x7fd4f0078990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8036000 tx=0x7fd4f803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.508+0000 7fd5117e9640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fd4f007e0c0 0x7fd4f0080500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.508+0000 7fc4e2203640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fc4c00822d0 0x7fc4c0084710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.508+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== osd.0 v2:172.21.15.135:6800/3069336338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd500015e50 con 0x7fd4f007e0c0 2024-05-09T12:20:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.509+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== osd.1 v2:172.21.15.135:6808/290955535 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4c0084de0 con 0x7fc4c00822d0 2024-05-09T12:20:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.521+0000 7fc4e1a02640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc4c007a6e0 0x7fc4c007cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.521+0000 7fc4e1a02640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc4c007a6e0 0x7fc4c007cba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc137d00 tx=0x7fc4d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.522+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 --> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd4009cbf0 con 0x7efd2407df80 2024-05-09T12:20:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.522+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 --> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efeb0002c70 con 0x7efebc07df30 2024-05-09T12:20:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.522+0000 7efd367fc640 1 -- 172.21.15.135:0/4205594834 <== osd.2 v2:172.21.15.160:6800/2987975206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd4009cbf0 con 0x7efd2407df80 2024-05-09T12:20:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.522+0000 7efeb7fff640 1 -- 172.21.15.135:0/2004130387 <== osd.3 v2:172.21.15.160:6808/2030310005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efeb0002c70 con 0x7efebc07df30 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7efd2407df80 msgr2=0x7efd240803c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7efd2407df80 0x7efd240803c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efd24076320 msgr2=0x7efd240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efd24076320 0x7efd240787e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005880 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 msgr2=0x7efd40132b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 --2- 172.21.15.135:0/4205594834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4013fa80 0x7efd40132b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd30000c00 tx=0x7efd300046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd464ae640 1 -- 172.21.15.135:0/4205594834 reap_dead start 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 shutdown_connections 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 >> 172.21.15.135:0/4205594834 conn(0x7efd400ab940 msgr2=0x7efd40136590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7efebc07df30 msgr2=0x7efebc080370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7efebc07df30 0x7efebc080370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 shutdown_connections 2024-05-09T12:20:30.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efebc0762d0 msgr2=0x7efebc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efd47f11640 1 -- 172.21.15.135:0/4205594834 wait complete. 2024-05-09T12:20:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7efebc0762d0 0x7efebc078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efec00017c0 tx=0x7efec0009040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 msgr2=0x7efed006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 --2- 172.21.15.135:0/2004130387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efed0136280 0x7efed006fef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec8004a40 comp rx=0 tx=0).stop 2024-05-09T12:20:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efecffff640 1 -- 172.21.15.135:0/2004130387 reap_dead start 2024-05-09T12:20:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 --> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd50c1248c0 con 0x7fd4f007e0c0 2024-05-09T12:20:30.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 shutdown_connections 2024-05-09T12:20:30.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 >> 172.21.15.135:0/2004130387 conn(0x7efed00aaf90 msgr2=0x7efed01307d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 shutdown_connections 2024-05-09T12:20:30.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.523+0000 7efed5aff640 1 -- 172.21.15.135:0/2004130387 wait complete. 2024-05-09T12:20:30.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd5097fa640 1 -- 172.21.15.135:0/976664067 <== osd.0 v2:172.21.15.135:6800/3069336338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd50c1248c0 con 0x7fd4f007e0c0 2024-05-09T12:20:30.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 --> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4dc0508d0 con 0x7fc4c00822d0 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fd4f007e0c0 msgr2=0x7fd4f0080500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fd4f007e0c0 0x7fd4f0080500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd4f00764d0 msgr2=0x7fd4f0078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd4f00764d0 0x7fd4f0078990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8036000 tx=0x7fd4f803c040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 msgr2=0x7fd50c122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 --2- 172.21.15.135:0/976664067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c09e340 0x7fd50c122fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd50000d800 tx=0x7fd50000dcc0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd5117e9640 1 -- 172.21.15.135:0/976664067 reap_dead start 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 shutdown_connections 2024-05-09T12:20:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 >> 172.21.15.135:0/976664067 conn(0x7fd50c0acb30 msgr2=0x7fd50c0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fc4d27fc640 1 -- 172.21.15.135:0/728507200 <== osd.1 v2:172.21.15.135:6808/290955535 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc4dc0508d0 con 0x7fc4c00822d0 2024-05-09T12:20:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 shutdown_connections 2024-05-09T12:20:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.524+0000 7fd51324c640 1 -- 172.21.15.135:0/976664067 wait complete. 2024-05-09T12:20:30.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fc4c00822d0 msgr2=0x7fc4c0084710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fc4c00822d0 0x7fc4c0084710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc4c007a6e0 msgr2=0x7fc4c007cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc4c007a6e0 0x7fc4c007cba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc137d00 tx=0x7fc4d8009190 comp rx=0 tx=0).stop 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 msgr2=0x7fc4dc135a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 --2- 172.21.15.135:0/728507200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4dc13a3d0 0x7fc4dc135a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc000c00 tx=0x7fc4cc0046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4e2203640 1 -- 172.21.15.135:0/728507200 reap_dead start 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 shutdown_connections 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 >> 172.21.15.135:0/728507200 conn(0x7fc4dc0aca30 msgr2=0x7fc4dc1381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 shutdown_connections 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.525+0000 7fc4bffff640 1 -- 172.21.15.135:0/728507200 wait complete. 2024-05-09T12:20:30.563 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:30.564 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:30.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T12:20:30.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T12:20:30.566 INFO:teuthology.orchestra.run.smithi135.stdout:38654705672 2024-05-09T12:20:30.567 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T12:20:30.567 INFO:teuthology.orchestra.run.smithi135.stdout:38654705672 2024-05-09T12:20:30.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T12:20:30.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.713+0000 7f260f34d640 1 Processor -- start 2024-05-09T12:20:30.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.713+0000 7f2e05c7e640 1 Processor -- start 2024-05-09T12:20:30.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 Processor -- start 2024-05-09T12:20:30.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f0b4baae640 1 Processor -- start 2024-05-09T12:20:30.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2e05c7e640 1 -- start start 2024-05-09T12:20:30.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260f34d640 1 -- start start 2024-05-09T12:20:30.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 -- start start 2024-05-09T12:20:30.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f0b4baae640 1 -- start start 2024-05-09T12:20:30.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260f34d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f260809b3d0 0x7f2608141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 0x7f9de013cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2e05c7e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2e05c7e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000a09a0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260f34d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26080a09a0 con 0x7f260813c850 2024-05-09T12:20:30.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260f34d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f260809b980 con 0x7f260813d340 2024-05-09T12:20:30.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260f34d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f260809c2a0 con 0x7f260809b3d0 2024-05-09T12:20:30.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 0x7f9de0139850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9de009c2a0 con 0x7f9de013c850 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f9de013d6b0 con 0x7f9de009b3d0 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de6e21640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9de009cdf0 con 0x7f9de01393c0 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260d0e9640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f260813c850 0x7f260813cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37184/0 (socket says 172.21.15.135:37184) 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260c8e8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f260809b3d0 0x7f2608141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f260d0e9640 1 -- 172.21.15.135:0/528345813 learned_addr learned my addr 172.21.15.135:0/528345813 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2e05c7e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0009b980 con 0x7f2e0013c850 2024-05-09T12:20:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2e05c7e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0009c2a0 con 0x7f2e0013d340 2024-05-09T12:20:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2dfeffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2e0009b3d0 0x7f2e00141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37194/0 (socket says 172.21.15.135:37194) 2024-05-09T12:20:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f2dfeffd640 1 -- 172.21.15.135:0/4129008907 learned_addr learned my addr 172.21.15.135:0/4129008907 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9de4bbd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 0x7f9de013cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfffff640 1 --2- 172.21.15.135:0/4129008907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9ddffff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.714+0000 7f9ddffff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51362/0 (socket says 172.21.15.135:51362) 2024-05-09T12:20:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de4bbd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 0x7f9de013cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41110/0 (socket says 172.21.15.135:41110) 2024-05-09T12:20:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9ddffff640 1 -- 172.21.15.135:0/1346772159 learned_addr learned my addr 172.21.15.135:0/1346772159 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 --2- 172.21.15.135:0/1346772159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 0x7f9de0139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4baae640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b440a4640 0x7f0b4406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b49049640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b440a4640 0x7f0b4406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f260c8e8640 1 -- 172.21.15.135:0/528345813 >> v1:172.21.15.160:6789/0 conn(0x7f260813d340 legacy=0x7f26081442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f260c8e8640 1 -- 172.21.15.135:0/528345813 >> v1:172.21.15.135:6789/0 conn(0x7f260813c850 legacy=0x7f260813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f260c8e8640 1 -- 172.21.15.135:0/528345813 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260809e670 con 0x7f260809b3d0 2024-05-09T12:20:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4984a640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0b44133330 0x7f0b44133710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37206/0 (socket says 172.21.15.135:37206) 2024-05-09T12:20:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b49049640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b440a4640 0x7f0b4406c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41124/0 (socket says 172.21.15.135:41124) 2024-05-09T12:20:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4baae640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b440a5890 con 0x7f0b44133330 2024-05-09T12:20:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967036351 0 0) 0x7f2e0009b980 con 0x7f2e0013c850 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4984a640 1 -- 172.21.15.135:0/2183092086 learned_addr learned my addr 172.21.15.135:0/2183092086 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b440a4c50 con 0x7f0b4406c610 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0b440a5b30 con 0x7f0b440a4640 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 -- 172.21.15.135:0/1346772159 >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 msgr2=0x7f9de013d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 --2- 172.21.15.135:0/1346772159 >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 -- 172.21.15.135:0/1346772159 >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 msgr2=0x7f9de013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 --2- 172.21.15.135:0/1346772159 >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 0x7f9de013cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9de53be640 1 -- 172.21.15.135:0/1346772159 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de00a09a0 con 0x7f9de01393c0 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f9ddffff640 1 --2- 172.21.15.135:0/1346772159 >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2de8003520 con 0x7f2e0013c850 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545149735 0 0) 0x7f2e000a09a0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0009b980 con 0x7f2e0009b3d0 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfffff640 1 -- 172.21.15.135:0/4129008907 >> v1:172.21.15.160:6789/0 conn(0x7f2e0013c850 legacy=0x7f2e0013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfffff640 1 -- 172.21.15.135:0/4129008907 >> v1:172.21.15.135:6789/0 conn(0x7f2e0009b3d0 legacy=0x7f2e00141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f2dfffff640 1 -- 172.21.15.135:0/4129008907 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0009e670 con 0x7f2e0013d340 2024-05-09T12:20:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203955379 0 0) 0x7f0b440a5890 con 0x7f0b44133330 2024-05-09T12:20:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b30003520 con 0x7f0b44133330 2024-05-09T12:20:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.715+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563884714 0 0) 0x7f0b440a4c50 con 0x7f0b4406c610 2024-05-09T12:20:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f0b49049640 1 -- 172.21.15.135:0/2183092086 >> v1:172.21.15.160:6789/0 conn(0x7f0b4406c610 legacy=0x7f0b4406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f0b49049640 1 -- 172.21.15.135:0/2183092086 >> v1:172.21.15.135:6789/0 conn(0x7f0b44133330 legacy=0x7f0b44133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f0b49049640 1 -- 172.21.15.135:0/2183092086 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b440a3dc0 con 0x7f0b440a4640 2024-05-09T12:20:30.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f260c8e8640 1 --2- 172.21.15.135:0/528345813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608141d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097a0 tx=0x7f25f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302aa87140877a04 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f9de53be640 1 --2- 172.21.15.135:0/1346772159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 0x7f9de0139850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ac860 tx=0x7f9dd802bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72f317df9fb87b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f25fffff640 1 -- 172.21.15.135:0/528345813 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8035020 con 0x7f260809b3d0 2024-05-09T12:20:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/1346772159 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8039070 con 0x7f9de01393c0 2024-05-09T12:20:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f25fffff640 1 -- 172.21.15.135:0/528345813 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8031830 con 0x7f260809b3d0 2024-05-09T12:20:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f25fffff640 1 -- 172.21.15.135:0/528345813 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8031c00 con 0x7f260809b3d0 2024-05-09T12:20:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f2dfffff640 1 --2- 172.21.15.135:0/4129008907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001454b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009dc0 tx=0x7f2df802bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9fb9d716455fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/1346772159 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd802cb50 con 0x7f9de01393c0 2024-05-09T12:20:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f9ddf7fe640 1 -- 172.21.15.135:0/1346772159 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8034440 con 0x7f9de01393c0 2024-05-09T12:20:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8039070 con 0x7f2e0013d340 2024-05-09T12:20:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df802cba0 con 0x7f2e0013d340 2024-05-09T12:20:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f2dfe7fc640 1 -- 172.21.15.135:0/4129008907 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8034440 con 0x7f2e0013d340 2024-05-09T12:20:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.716+0000 7f0b49049640 1 --2- 172.21.15.135:0/2183092086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4406c0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b340097a0 tx=0x7f0b3402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415d5515a786241 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b340315a0 con 0x7f0b440a4640 2024-05-09T12:20:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34037070 con 0x7f0b440a4640 2024-05-09T12:20:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f0b48848640 1 -- 172.21.15.135:0/2183092086 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34031940 con 0x7f0b440a4640 2024-05-09T12:20:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 -- 172.21.15.135:0/4129008907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 msgr2=0x7f2e001454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/4129008907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001454b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009dc0 tx=0x7f2df802bdf0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 -- 172.21.15.135:0/4129008907 shutdown_connections 2024-05-09T12:20:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/4129008907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001454b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 -- 172.21.15.135:0/4129008907 >> 172.21.15.135:0/4129008907 conn(0x7f2e00075cf0 msgr2=0x7f2e000aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 -- 172.21.15.135:0/528345813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 msgr2=0x7f2608141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 --2- 172.21.15.135:0/528345813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608141d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097a0 tx=0x7f25f802b8d0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 -- 172.21.15.135:0/4129008907 shutdown_connections 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f2e05c7e640 1 -- 172.21.15.135:0/4129008907 wait complete. 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 -- 172.21.15.135:0/1346772159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 msgr2=0x7f9de0139850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 --2- 172.21.15.135:0/1346772159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 0x7f9de0139850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ac860 tx=0x7f9dd802bda0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 -- 172.21.15.135:0/528345813 shutdown_connections 2024-05-09T12:20:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 --2- 172.21.15.135:0/528345813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608141d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 -- 172.21.15.135:0/528345813 >> 172.21.15.135:0/528345813 conn(0x7f2608075cf0 msgr2=0x7f26080aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 -- 172.21.15.135:0/1346772159 shutdown_connections 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 --2- 172.21.15.135:0/1346772159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de01393c0 0x7f9de0139850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 --2- 172.21.15.135:0/1346772159 >> v2:172.21.15.160:3300/0 conn(0x7f9de009b3d0 0x7f9de013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 --2- 172.21.15.135:0/1346772159 >> v2:172.21.15.135:3300/0 conn(0x7f9de013c850 0x7f9de013cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f9de6e21640 1 -- 172.21.15.135:0/1346772159 >> 172.21.15.135:0/1346772159 conn(0x7f9de0075cf0 msgr2=0x7f9de00aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f260f34d640 1 -- 172.21.15.135:0/528345813 shutdown_connections 2024-05-09T12:20:30.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 msgr2=0x7f0b4406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.717+0000 7f0b4baae640 1 --2- 172.21.15.135:0/2183092086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4406c0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0b340097a0 tx=0x7f0b3402b840 comp rx=0 tx=0).stop 2024-05-09T12:20:30.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f260f34d640 1 -- 172.21.15.135:0/528345813 wait complete. 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f9de6e21640 1 -- 172.21.15.135:0/1346772159 shutdown_connections 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f9de6e21640 1 -- 172.21.15.135:0/1346772159 wait complete. 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 shutdown_connections 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f0b4baae640 1 --2- 172.21.15.135:0/2183092086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4406c0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 >> 172.21.15.135:0/2183092086 conn(0x7f0b440a87a0 msgr2=0x7f0b440ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 shutdown_connections 2024-05-09T12:20:30.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f0b4baae640 1 -- 172.21.15.135:0/2183092086 wait complete. 2024-05-09T12:20:30.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.718+0000 7f2e05c7e640 1 Processor -- start 2024-05-09T12:20:30.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 Processor -- start 2024-05-09T12:20:30.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 -- start start 2024-05-09T12:20:30.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f2e05c7e640 1 -- start start 2024-05-09T12:20:30.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f9de6e21640 1 Processor -- start 2024-05-09T12:20:30.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f9de6e21640 1 -- start start 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f260813c850 0x7f2608139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260813d340 0x7f26081d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f260809bc70 con 0x7f260809b3d0 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260d0e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f260809cdf0 con 0x7f260813d340 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260f34d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f260809c9a0 con 0x7f260813c850 2024-05-09T12:20:30.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f0b4baae640 1 Processor -- start 2024-05-09T12:20:30.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260d0e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41140/0 (socket says 172.21.15.135:41140) 2024-05-09T12:20:30.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260d0e9640 1 -- 172.21.15.135:0/3712204319 learned_addr learned my addr 172.21.15.135:0/3712204319 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f0b4baae640 1 -- start start 2024-05-09T12:20:30.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260c8e8640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f260813c850 0x7f2608139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.719+0000 7f260d8ea640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260813d340 0x7f26081d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 -- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f260813c850 msgr2=0x7f2608139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f260813c850 0x7f2608139c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 -- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260813d340 msgr2=0x7f26081d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260813d340 0x7f26081d1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 -- 172.21.15.135:0/3712204319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26080a8910 con 0x7f260809b3d0 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 0x7f9de01d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 0x7f9de01d2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9de009e670 con 0x7f9de01393c0 2024-05-09T12:20:30.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9de009bc70 con 0x7f9de009b3d0 2024-05-09T12:20:30.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de6e21640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9de009aa20 con 0x7f9de013c850 2024-05-09T12:20:30.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0013c850 0x7f2e000a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260d0e9640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f260400c420 tx=0x7f260400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de4bbd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 0x7f9de01d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41148/0 (socket says 172.21.15.135:41148) 2024-05-09T12:20:30.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 -- 172.21.15.135:0/3368204190 learned_addr learned my addr 172.21.15.135:0/3368204190 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de53be640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 0x7f9de01d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0009bc70 con 0x7f2e0009b3d0 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2dff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2dff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41150/0 (socket says 172.21.15.135:41150) 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2dff7fe640 1 -- 172.21.15.135:0/972022232 learned_addr learned my addr 172.21.15.135:0/972022232 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2dfeffd640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0013c850 0x7f2e000a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2dfffff640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604017070 con 0x7f260809b3d0 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0009cdf0 con 0x7f2e0013c850 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0009c9a0 con 0x7f2e0013d340 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 -- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 msgr2=0x7f9de01d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 0x7f9de01d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 -- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 msgr2=0x7f9de01d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 0x7f9de01d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604005ce0 con 0x7f260809b3d0 2024-05-09T12:20:30.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26080a8480 con 0x7f260809b3d0 2024-05-09T12:20:30.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9ddffff640 1 -- 172.21.15.135:0/3368204190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de009f600 con 0x7f9de01393c0 2024-05-09T12:20:30.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de4bbd640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 0x7f9de01d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:30.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f9de53be640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 0x7f9de01d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4413c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b44133330 0x7f0b4413cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4409f390 con 0x7f0b440a4640 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b440a4f10 con 0x7f0b4406c610 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4baae640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0b440ac030 con 0x7f0b44133330 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.720+0000 7f0b4984a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 -- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 msgr2=0x7f2e001d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51406/0 (socket says 172.21.15.135:51406) 2024-05-09T12:20:30.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 -- 172.21.15.135:0/3103076682 learned_addr learned my addr 172.21.15.135:0/3103076682 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:30.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4a04b640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b44133330 0x7f0b4413cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26080a68e0 con 0x7f260809b3d0 2024-05-09T12:20:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b49049640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 -- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0013c850 msgr2=0x7f2e000a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0013c850 0x7f2e000a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e000aa0c0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 -- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b44133330 msgr2=0x7f0b4413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b44133330 0x7f0b4413cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 -- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 msgr2=0x7f0b4413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4413c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 -- 172.21.15.135:0/3103076682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4413e1f0 con 0x7f0b4406c610 2024-05-09T12:20:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2dff7fe640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c430 tx=0x7f2df000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b49049640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4413c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f9ddffff640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00e9b0 tx=0x7f9dcc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604007310 con 0x7f260809b3d0 2024-05-09T12:20:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc017070 con 0x7f9de01393c0 2024-05-09T12:20:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b4984a640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c440 tx=0x7f0b4000c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de0125400 con 0x7f9de01393c0 2024-05-09T12:20:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de00abdb0 con 0x7f9de01393c0 2024-05-09T12:20:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b4406c610 2024-05-09T12:20:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0017070 con 0x7f2e0009b3d0 2024-05-09T12:20:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df00052d0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e000aa4f0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b40005ce0 con 0x7f0b4406c610 2024-05-09T12:20:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4413e490 con 0x7f0b4406c610 2024-05-09T12:20:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00c9a0 con 0x7f9de01393c0 2024-05-09T12:20:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00cd50 con 0x7f9de01393c0 2024-05-09T12:20:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4409bc60 con 0x7f0b4406c610 2024-05-09T12:20:30.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.721+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0003830 con 0x7f2e0009b3d0 2024-05-09T12:20:30.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26080508d0 con 0x7f260809b3d0 2024-05-09T12:20:30.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.722+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e000a9460 con 0x7f2e0009b3d0 2024-05-09T12:20:30.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.723+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0005080 con 0x7f9de01393c0 2024-05-09T12:20:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.723+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40007270 con 0x7f0b4406c610 2024-05-09T12:20:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.723+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f260401a070 con 0x7f260809b3d0 2024-05-09T12:20:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.723+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e000508d0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f25fdffb640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 0x7f25ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b440508d0 con 0x7f0b4406c610 2024-05-09T12:20:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b4001a070 con 0x7f0b4406c610 2024-05-09T12:20:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f2604096470 con 0x7f260809b3d0 2024-05-09T12:20:30.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f260c8e8640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 0x7f25ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9dcc01a070 con 0x7f9de01393c0 2024-05-09T12:20:30.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.724+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2df001a070 con 0x7f2e0009b3d0 2024-05-09T12:20:30.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f0b3a7fc640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 0x7f0b28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f9ddd7fa640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 0x7f9dc4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f0b49049640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 0x7f0b28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f0b40096170 con 0x7f0b4406c610 2024-05-09T12:20:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f9de4bbd640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 0x7f9dc4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f9dcc097140 con 0x7f9de01393c0 2024-05-09T12:20:30.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f260c8e8640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 0x7f25ec078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f2de7fff640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 0x7f2dec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:30.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f0b49049640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 0x7f0b28078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b34036000 tx=0x7f0b34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f2df00963e0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f2dfeffd640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 0x7f2dec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:30.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.725+0000 7f9de4bbd640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 0x7f9dc4078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009eb0 tx=0x7f9dd4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.726+0000 7f2dfeffd640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 0x7f2dec0787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e0013bf80 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:30.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.729+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2604060320 con 0x7f260809b3d0 2024-05-09T12:20:30.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.730+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b4005fa70 con 0x7f0b4406c610 2024-05-09T12:20:30.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.733+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9dcc0609a0 con 0x7f9de01393c0 2024-05-09T12:20:30.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.738+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2df005fc40 con 0x7f2e0009b3d0 2024-05-09T12:20:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.919+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2608073f30 con 0x7f260809b3d0 2024-05-09T12:20:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.919+0000 7f25fdffb640 1 -- 172.21.15.135:0/3712204319 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f260405fc20 con 0x7f260809b3d0 2024-05-09T12:20:30.919 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 msgr2=0x7f25ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 0x7f25ec078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25f8036000 tx=0x7f25f8008030 comp rx=0 tx=0).stop 2024-05-09T12:20:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 msgr2=0x7f2608139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f260400c420 tx=0x7f260400c8e0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 shutdown_connections 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f25ec0762d0 0x7f25ec078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f260813d340 0x7f26081d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f260813c850 0x7f2608139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 --2- 172.21.15.135:0/3712204319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260809b3d0 0x7f2608139710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 >> 172.21.15.135:0/3712204319 conn(0x7f2608075cf0 msgr2=0x7f26080acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 shutdown_connections 2024-05-09T12:20:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.922+0000 7f260f34d640 1 -- 172.21.15.135:0/3712204319 wait complete. 2024-05-09T12:20:30.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.928+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9dc0005370 con 0x7f9de01393c0 2024-05-09T12:20:30.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.928+0000 7f9ddd7fa640 1 -- 172.21.15.135:0/3368204190 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9dcc064ca0 con 0x7f9de01393c0 2024-05-09T12:20:30.928 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:30.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 msgr2=0x7f9dc4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 0x7f9dc4078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009eb0 tx=0x7f9dd4009190 comp rx=0 tx=0).stop 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 msgr2=0x7f9de01d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00e9b0 tx=0x7f9dcc00ee70 comp rx=0 tx=0).stop 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 shutdown_connections 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9dc40762d0 0x7f9dc4078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9de013c850 0x7f9de01d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9de01393c0 0x7f9de01d22c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 --2- 172.21.15.135:0/3368204190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9de009b3d0 0x7f9de01d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 >> 172.21.15.135:0/3368204190 conn(0x7f9de0075cf0 msgr2=0x7f9de006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 shutdown_connections 2024-05-09T12:20:30.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.932+0000 7f9de6e21640 1 -- 172.21.15.135:0/3368204190 wait complete. 2024-05-09T12:20:30.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.1 2024-05-09T12:20:30.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.934+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0b4413c1e0 con 0x7f0b4406c610 2024-05-09T12:20:30.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.934+0000 7f0b3a7fc640 1 -- 172.21.15.135:0/3103076682 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b40063d70 con 0x7f0b4406c610 2024-05-09T12:20:30.938 INFO:teuthology.orchestra.run.smithi135.stdout:38654705668 2024-05-09T12:20:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 msgr2=0x7f0b28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 0x7f0b28078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b34036000 tx=0x7f0b34008030 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 msgr2=0x7f0b4413b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c440 tx=0x7f0b4000c900 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 shutdown_connections 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f0b280762d0 0x7f0b28078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b44133330 0x7f0b4413cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b440a4640 0x7f0b4413c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 --2- 172.21.15.135:0/3103076682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b4406c610 0x7f0b4413b5d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 >> 172.21.15.135:0/3103076682 conn(0x7f0b440a87a0 msgr2=0x7f0b440a5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 shutdown_connections 2024-05-09T12:20:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.938+0000 7f0b4baae640 1 -- 172.21.15.135:0/3103076682 wait complete. 2024-05-09T12:20:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.945+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2e000a8ca0 con 0x7f2e0009b3d0 2024-05-09T12:20:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.945+0000 7f2de7fff640 1 -- 172.21.15.135:0/972022232 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2df0063f40 con 0x7f2e0009b3d0 2024-05-09T12:20:30.945 INFO:teuthology.orchestra.run.smithi135.stdout:38654705668 2024-05-09T12:20:30.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 msgr2=0x7f2dec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 0x7f2dec0787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e0013bf80 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2024-05-09T12:20:30.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 msgr2=0x7f2e000a79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c430 tx=0x7f2df000c8f0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 shutdown_connections 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f2dec076320 0x7f2dec0787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e0013d340 0x7f2e001d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e0013c850 0x7f2e000a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 --2- 172.21.15.135:0/972022232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e0009b3d0 0x7f2e000a79b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 >> 172.21.15.135:0/972022232 conn(0x7f2e00075cf0 msgr2=0x7f2e0013a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 shutdown_connections 2024-05-09T12:20:30.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:30.947+0000 7f2e05c7e640 1 -- 172.21.15.135:0/972022232 wait complete. 2024-05-09T12:20:30.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.0 2024-05-09T12:20:30.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.2 2024-05-09T12:20:30.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.3 2024-05-09T12:20:31.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T12:20:31.951 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T12:20:31.953 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T12:20:31.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T12:20:32.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.054+0000 7f996cef9640 1 Processor -- start 2024-05-09T12:20:32.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.054+0000 7f996cef9640 1 -- start start 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996cef9640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9968136b30 0x7f996806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996cef9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99680a9080 con 0x7f9968136750 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996cef9640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996809f750 con 0x7f9968142a10 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996cef9640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f996809d8c0 con 0x7f9968136b30 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996659c640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9968136750 0x7f996806c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37222/0 (socket says 172.21.15.135:37222) 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996659c640 1 -- 172.21.15.135:0/378000814 learned_addr learned my addr 172.21.15.135:0/378000814 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f9965d9b640 1 --2- 172.21.15.135:0/378000814 >> v2:172.21.15.160:3300/0 conn(0x7f9968136b30 0x7f996806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996559a640 1 -- 172.21.15.135:0/378000814 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096322908 0 0) 0x7f99680a9080 con 0x7f9968136750 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f996559a640 1 -- 172.21.15.135:0/378000814 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9950003520 con 0x7f9968136750 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f9965d9b640 1 -- 172.21.15.135:0/378000814 >> v1:172.21.15.160:6789/0 conn(0x7f9968142a10 legacy=0x7f9968144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f9965d9b640 1 -- 172.21.15.135:0/378000814 >> v1:172.21.15.135:6789/0 conn(0x7f9968136750 legacy=0x7f996806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.055+0000 7f9965d9b640 1 -- 172.21.15.135:0/378000814 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996809c360 con 0x7f9968136b30 2024-05-09T12:20:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f9965d9b640 1 --2- 172.21.15.135:0/378000814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136b30 0x7f996806c7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f995c0097a0 tx=0x7f995c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b46b4d110f9a23b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f996559a640 1 -- 172.21.15.135:0/378000814 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c0315a0 con 0x7f9968136b30 2024-05-09T12:20:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f996559a640 1 -- 172.21.15.135:0/378000814 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c037070 con 0x7f9968136b30 2024-05-09T12:20:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f996559a640 1 -- 172.21.15.135:0/378000814 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c031960 con 0x7f9968136b30 2024-05-09T12:20:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f996cef9640 1 -- 172.21.15.135:0/378000814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136b30 msgr2=0x7f996806c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.057+0000 7f996cef9640 1 --2- 172.21.15.135:0/378000814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136b30 0x7f996806c7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f995c0097a0 tx=0x7f995c02b840 comp rx=0 tx=0).stop 2024-05-09T12:20:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.058+0000 7f996cef9640 1 -- 172.21.15.135:0/378000814 shutdown_connections 2024-05-09T12:20:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.058+0000 7f996cef9640 1 --2- 172.21.15.135:0/378000814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136b30 0x7f996806c7e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.058+0000 7f996cef9640 1 -- 172.21.15.135:0/378000814 >> 172.21.15.135:0/378000814 conn(0x7f99680aba90 msgr2=0x7f99680abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.058+0000 7f996cef9640 1 -- 172.21.15.135:0/378000814 shutdown_connections 2024-05-09T12:20:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.058+0000 7f996cef9640 1 -- 172.21.15.135:0/378000814 wait complete. 2024-05-09T12:20:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 Processor -- start 2024-05-09T12:20:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 -- start start 2024-05-09T12:20:32.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 0x7f9968132350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 0x7f99681d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99680a0330 con 0x7f9968136b30 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f996809d580 con 0x7f9968136750 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.059+0000 7f996cef9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f996809c820 con 0x7f9968142a10 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41158/0 (socket says 172.21.15.135:41158) 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 -- 172.21.15.135:0/2615050536 learned_addr learned my addr 172.21.15.135:0/2615050536 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f996659c640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 0x7f9968132350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 -- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 msgr2=0x7f99681d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9966d9d640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 0x7f99681d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 0x7f99681d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 -- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 msgr2=0x7f9968132350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 0x7f9968132350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 -- 172.21.15.135:0/2615050536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680a8380 con 0x7f9968136b30 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f996659c640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 0x7f9968132350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9966d9d640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 0x7f99681d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.060+0000 7f9965d9b640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f995c034040 tx=0x7f995c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.061+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c032630 con 0x7f9968136b30 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.061+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c0327d0 con 0x7f9968136b30 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.061+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c032bc0 con 0x7f9968136b30 2024-05-09T12:20:32.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.061+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99681415e0 con 0x7f9968136b30 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.061+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9968142270 con 0x7f9968136b30 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.062+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996813d510 con 0x7f9968136b30 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.063+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f995c04e430 con 0x7f9968136b30 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.063+0000 7f9956ffd640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.064+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f995c02f030 con 0x7f9968136b30 2024-05-09T12:20:32.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.064+0000 7f996659c640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.064+0000 7f996659c640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 0x7f9948078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9958005880 tx=0x7f9958007cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.072+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f995c040070 con 0x7f9968136b30 2024-05-09T12:20:32.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.094+0000 7f36c3676640 1 Processor -- start 2024-05-09T12:20:32.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.094+0000 7f36c3676640 1 -- start start 2024-05-09T12:20:32.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.094+0000 7f27913e8640 1 Processor -- start 2024-05-09T12:20:32.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.094+0000 7f27913e8640 1 -- start start 2024-05-09T12:20:32.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c3676640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc0a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c3676640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36bc133710 0x7f36bc0aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c3676640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc0a5890 con 0x7f36bc0aaae0 2024-05-09T12:20:32.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c3676640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f36bc0a5b30 con 0x7f36bc133710 2024-05-09T12:20:32.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c3676640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0a4f10 con 0x7f36bc133330 2024-05-09T12:20:32.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c1c13640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f36bc0aaae0 0x7f36bc140820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37226/0 (socket says 172.21.15.135:37226) 2024-05-09T12:20:32.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c1c13640 1 -- 172.21.15.135:0/4260595580 learned_addr learned my addr 172.21.15.135:0/4260595580 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:32.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c0c11640 1 --2- 172.21.15.135:0/4260595580 >> v2:172.21.15.160:3300/0 conn(0x7f36bc133710 0x7f36bc0aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f27913e8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c0a5080 0x7f278c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f278affd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f278c135ea0 0x7f278c138c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37242/0 (socket says 172.21.15.135:37242) 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f278affd640 1 -- 172.21.15.135:0/1593527270 learned_addr learned my addr 172.21.15.135:0/1593527270 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36b3fff640 1 -- 172.21.15.135:0/4260595580 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951365296 0 0) 0x7f36bc0a5890 con 0x7f36bc0aaae0 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c1412640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc0a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36b3fff640 1 -- 172.21.15.135:0/4260595580 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a8003520 con 0x7f36bc0aaae0 2024-05-09T12:20:32.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c0c11640 1 -- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 msgr2=0x7f36bc0a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c0c11640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc0a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c0c11640 1 -- 172.21.15.135:0/4260595580 >> v1:172.21.15.135:6789/0 conn(0x7f36bc0aaae0 legacy=0x7f36bc140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f36c0c11640 1 -- 172.21.15.135:0/4260595580 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0a4c50 con 0x7f36bc133710 2024-05-09T12:20:32.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f36c1412640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc0a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c139a40 con 0x7f278c135ea0 2024-05-09T12:20:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.095+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c0a3b10 con 0x7f278c136280 2024-05-09T12:20:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319601848 0 0) 0x7f278c139a40 con 0x7f278c135ea0 2024-05-09T12:20:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f278b7fe640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c0a5080 0x7f278c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0a38f0 con 0x7f278c0a5080 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2774003520 con 0x7f278c135ea0 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150500171 0 0) 0x7f278c0a3b10 con 0x7f278c136280 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f278c139a40 con 0x7f278c136280 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 6069815 0 0) 0x7f2774003520 con 0x7f278c135ea0 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c0a5080 msgr2=0x7f278c141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c0a5080 0x7f278c141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 >> v1:172.21.15.160:6789/0 conn(0x7f278c136280 legacy=0x7f278c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0a3f00 con 0x7f278c135ea0 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f277c0016f0 con 0x7f278c135ea0 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 >> v1:172.21.15.135:6789/0 conn(0x7f278c135ea0 legacy=0x7f278c138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2774003cb0 0x7f27740040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2774004800 0x7f2774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2774005390 0x7f277400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0a38f0 con 0x7f2774004800 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f277400c260 con 0x7f2774005390 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f277400c460 con 0x7f2774003cb0 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f278a7fc640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2774004800 0x7f2774004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.096+0000 7f278affd640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2774003cb0 0x7f27740040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f278a7fc640 1 -- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2774003cb0 msgr2=0x7f27740040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f278a7fc640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2774003cb0 0x7f27740040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f278a7fc640 1 -- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2774005390 msgr2=0x7f277400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f278a7fc640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2774005390 0x7f277400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f278a7fc640 1 -- 172.21.15.135:0/1593527270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2774003520 con 0x7f2774004800 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f36c0c11640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc0aa5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00ba40 tx=0x7f36ac02df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dddb7b1af173dadd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f36b3fff640 1 -- 172.21.15.135:0/4260595580 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac03b070 con 0x7f36bc133710 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f36b3fff640 1 -- 172.21.15.135:0/4260595580 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac02ed20 con 0x7f36bc133710 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.097+0000 7f36b3fff640 1 -- 172.21.15.135:0/4260595580 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac036660 con 0x7f36bc133710 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 Processor -- start 2024-05-09T12:20:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 -- start start 2024-05-09T12:20:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f278a7fc640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2774004800 0x7f2774004c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2780001770 tx=0x7f2774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fdfe7c82a7f7d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780001390 con 0x7f2774004800 2024-05-09T12:20:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27800052d0 con 0x7f2774004800 2024-05-09T12:20:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f2789ffb640 1 -- 172.21.15.135:0/1593527270 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780003830 con 0x7f2774004800 2024-05-09T12:20:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 -- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 msgr2=0x7f36bc0aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc0aa5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00ba40 tx=0x7f36ac02df70 comp rx=0 tx=0).stop 2024-05-09T12:20:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 -- 172.21.15.135:0/4260595580 shutdown_connections 2024-05-09T12:20:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc0aa5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 --2- 172.21.15.135:0/4260595580 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc0a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 -- 172.21.15.135:0/4260595580 >> 172.21.15.135:0/4260595580 conn(0x7f36bc0a87a0 msgr2=0x7f36bc0ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe078139b60 0x7fe078139f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe0780a7160 0x7fe0780a2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0780a4940 con 0x7fe0780a2960 2024-05-09T12:20:32.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fe0780a4680 con 0x7fe0780a7160 2024-05-09T12:20:32.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7fe07d227640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe0780a5370 con 0x7fe078139b60 2024-05-09T12:20:32.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 -- 172.21.15.135:0/4260595580 shutdown_connections 2024-05-09T12:20:32.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.098+0000 7f36c3676640 1 -- 172.21.15.135:0/4260595580 wait complete. 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe0780a7160 0x7fe0780a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe076d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe078139b60 0x7fe078139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe0780a7160 0x7fe0780a2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51446/0 (socket says 172.21.15.135:51446) 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 -- 172.21.15.135:0/1366876 learned_addr learned my addr 172.21.15.135:0/1366876 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe075d9b640 1 -- 172.21.15.135:0/1366876 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960939081 0 0) 0x7fe0780a4940 con 0x7fe0780a2960 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe075d9b640 1 -- 172.21.15.135:0/1366876 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe060003520 con 0x7fe0780a2960 2024-05-09T12:20:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2774004800 msgr2=0x7f2774004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 --2- 172.21.15.135:0/1593527270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2774004800 0x7f2774004c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2780001770 tx=0x7f2774005830 comp rx=0 tx=0).stop 2024-05-09T12:20:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 -- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe078139b60 msgr2=0x7fe078139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 --2- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe078139b60 0x7fe078139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 -- 172.21.15.135:0/1366876 >> v1:172.21.15.160:6789/0 conn(0x7fe0780a2960 legacy=0x7fe0781408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f278b7fe640 1 -- 172.21.15.135:0/1593527270 reap_dead start 2024-05-09T12:20:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7fe07659c640 1 -- 172.21.15.135:0/1366876 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07813a480 con 0x7fe0780a7160 2024-05-09T12:20:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 shutdown_connections 2024-05-09T12:20:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 >> 172.21.15.135:0/1593527270 conn(0x7f278c0aaf90 msgr2=0x7f278c0ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 shutdown_connections 2024-05-09T12:20:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.099+0000 7f27913e8640 1 -- 172.21.15.135:0/1593527270 wait complete. 2024-05-09T12:20:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 Processor -- start 2024-05-09T12:20:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 -- start start 2024-05-09T12:20:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7fe07659c640 1 --2- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe0780a2420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b920 tx=0x7fe06c02bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35d6ad086ad4d20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc0aaae0 0x7f36bc1d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc1d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0a2d20 con 0x7f36bc0aaae0 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc09f390 con 0x7f36bc133710 2024-05-09T12:20:32.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c3676640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc133b70 con 0x7f36bc133330 2024-05-09T12:20:32.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7fe075d9b640 1 -- 172.21.15.135:0/1366876 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c039070 con 0x7fe0780a7160 2024-05-09T12:20:32.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7fe075d9b640 1 -- 172.21.15.135:0/1366876 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c02cc50 con 0x7fe0780a7160 2024-05-09T12:20:32.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f27913e8640 1 Processor -- start 2024-05-09T12:20:32.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c1412640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc0aaae0 0x7f36bc1d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f27913e8640 1 -- start start 2024-05-09T12:20:32.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7fe075d9b640 1 -- 172.21.15.135:0/1366876 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c039070 con 0x7fe0780a7160 2024-05-09T12:20:32.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c1c13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c0c11640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc1d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c1c13640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51452/0 (socket says 172.21.15.135:51452) 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.100+0000 7f36c1c13640 1 -- 172.21.15.135:0/1887529282 learned_addr learned my addr 172.21.15.135:0/1887529282 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 -- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 msgr2=0x7f36bc1d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 -- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc0aaae0 msgr2=0x7f36bc1d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc0aaae0 0x7f36bc1d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 -- 172.21.15.135:0/1887529282 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc070b40 con 0x7f36bc133330 2024-05-09T12:20:32.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c1c13640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 -- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 msgr2=0x7fe0780a2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 --2- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe0780a2420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b920 tx=0x7fe06c02bf00 comp rx=0 tx=0).stop 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 0x7f278c1d5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0a2180 con 0x7f278c1cdd20 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0a54b0 con 0x7f278c0a0af0 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 -- 172.21.15.135:0/1366876 shutdown_connections 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 --2- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe0780a2420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 --2- 172.21.15.135:0/1366876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe078139b60 0x7fe078139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 -- 172.21.15.135:0/1366876 >> 172.21.15.135:0/1366876 conn(0x7fe0780aaeb0 msgr2=0x7fe0780ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36c0c11640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc1d2140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f36bc076280 tx=0x7f36ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41188/0 (socket says 172.21.15.135:41188) 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278a7fc640 1 -- 172.21.15.135:0/2116741254 learned_addr learned my addr 172.21.15.135:0/2116741254 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278affd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:51458/0 (socket says 172.21.15.135:51458) 2024-05-09T12:20:32.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0a2dc0 con 0x7f278c1ce6a0 2024-05-09T12:20:32.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 -- 172.21.15.135:0/1366876 shutdown_connections 2024-05-09T12:20:32.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7fe07d227640 1 -- 172.21.15.135:0/1366876 wait complete. 2024-05-09T12:20:32.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f278b7fe640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 0x7f278c1d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 -- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 msgr2=0x7f278c1d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac03b040 con 0x7f36bc133330 2024-05-09T12:20:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 0x7f278c1d5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 -- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 msgr2=0x7f278c1ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c09ec90 con 0x7f278c0a0af0 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278a7fc640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278b7fe640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 0x7f278c1d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.101+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac03f440 con 0x7f36bc133330 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc09e340 con 0x7f36bc133330 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac03f810 con 0x7f36bc133330 2024-05-09T12:20:32.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f278affd640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f277c001220 tx=0x7f277c00cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc070820 con 0x7f36bc133330 2024-05-09T12:20:32.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c007370 con 0x7f278c0a0af0 2024-05-09T12:20:32.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c014030 con 0x7f278c0a0af0 2024-05-09T12:20:32.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c09dc10 con 0x7f278c0a0af0 2024-05-09T12:20:32.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0048a0 con 0x7f278c0a0af0 2024-05-09T12:20:32.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.102+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1ceb20 con 0x7f278c0a0af0 2024-05-09T12:20:32.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7fe07d227640 1 Processor -- start 2024-05-09T12:20:32.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7fe07d227640 1 -- start start 2024-05-09T12:20:32.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0508d0 con 0x7f36bc133330 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7fe07d227640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 0x7fe07809e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7fe07d227640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe07809ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.103+0000 7fe07d227640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07d227640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0780a4c20 con 0x7fe078139b60 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07d227640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe0780a41b0 con 0x7fe0780a7160 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07d227640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe078070150 con 0x7fe0780a2960 2024-05-09T12:20:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c09d7b0 con 0x7f278c0a0af0 2024-05-09T12:20:32.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe076d9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 0x7fe07809e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41200/0 (socket says 172.21.15.135:41200) 2024-05-09T12:20:32.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 -- 172.21.15.135:0/529888853 learned_addr learned my addr 172.21.15.135:0/529888853 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07659c640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe07809ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 -- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 msgr2=0x7fe07809e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 0x7fe07809e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 -- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 msgr2=0x7fe07809ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe07809ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 -- 172.21.15.135:0/529888853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0780a1460 con 0x7fe078139b60 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe076d9d640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 0x7fe07809e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:20:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36ac046030 con 0x7f36bc133330 2024-05-09T12:20:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f277c004a40 con 0x7f278c0a0af0 2024-05-09T12:20:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe07759e640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c730 tx=0x7fe07000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.104+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070003b70 con 0x7fe078139b60 2024-05-09T12:20:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe070003d30 con 0x7fe078139b60 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07812a330 con 0x7fe078139b60 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07000aa90 con 0x7fe078139b60 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0781377c0 con 0x7fe078139b60 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f27737fe640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 0x7f2778078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f277c096860 con 0x7f278c0a0af0 2024-05-09T12:20:32.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f36b1ffb640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 0x7f36a00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f278a7fc640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 0x7f2778078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f36c1412640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 0x7f36a00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.105+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f36ac0b86b0 con 0x7f36bc133330 2024-05-09T12:20:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.106+0000 7f36c1412640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 0x7f36a00787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006e80 tx=0x7f36b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.106+0000 7f278a7fc640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 0x7f2778078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2780001010 tx=0x7f2780039000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.106+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe078069d10 con 0x7fe078139b60 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.107+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe07000ac30 con 0x7fe078139b60 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.107+0000 7fe05f7fe640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 0x7fe064078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.108+0000 7fe076d9d640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 0x7fe064078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.108+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fe070096cb0 con 0x7fe078139b60 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.108+0000 7fe076d9d640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 0x7fe064078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d440 tx=0x7fe06800f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.109+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f277c00e040 con 0x7f278c0a0af0 2024-05-09T12:20:32.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.110+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36ac04d020 con 0x7f36bc133330 2024-05-09T12:20:32.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.114+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe078069d10 con 0x7fe078139b60 2024-05-09T12:20:32.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.270+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9968137150 con 0x7f9968136b30 2024-05-09T12:20:32.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.271+0000 7f9956ffd640 1 -- 172.21.15.135:0/2615050536 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f995c082d70 con 0x7f9968136b30 2024-05-09T12:20:32.270 INFO:teuthology.orchestra.run.smithi135.stdout:38654705672 2024-05-09T12:20:32.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 msgr2=0x7f9948078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 0x7f9948078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9958005880 tx=0x7f9958007cd0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 msgr2=0x7f9968132890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f995c034040 tx=0x7f995c0046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 shutdown_connections 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f99480762d0 0x7f9948078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9968142a10 0x7f99681d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9968136b30 0x7f9968132890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 --2- 172.21.15.135:0/2615050536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9968136750 0x7f9968132350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 >> 172.21.15.135:0/2615050536 conn(0x7f99680aba90 msgr2=0x7f99681391e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 shutdown_connections 2024-05-09T12:20:32.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.274+0000 7f996cef9640 1 -- 172.21.15.135:0/2615050536 wait complete. 2024-05-09T12:20:32.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-05-09T12:20:32.289 DEBUG:teuthology.parallel:result is None 2024-05-09T12:20:32.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.299+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f278c0508d0 con 0x7f278c0a0af0 2024-05-09T12:20:32.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.300+0000 7f27737fe640 1 -- 172.21.15.135:0/2116741254 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f277c0600c0 con 0x7f278c0a0af0 2024-05-09T12:20:32.299 INFO:teuthology.orchestra.run.smithi135.stdout:38654705672 2024-05-09T12:20:32.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.300+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f36bc0a3650 con 0x7f36bc133330 2024-05-09T12:20:32.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.301+0000 7f36b1ffb640 1 -- 172.21.15.135:0/1887529282 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36ac081f90 con 0x7f36bc133330 2024-05-09T12:20:32.300 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:32.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 msgr2=0x7f2778078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 0x7f2778078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2780001010 tx=0x7f2780039000 comp rx=0 tx=0).stop 2024-05-09T12:20:32.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 msgr2=0x7f278c0a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f277c001220 tx=0x7f277c00cb70 comp rx=0 tx=0).stop 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 shutdown_connections 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f27780762d0 0x7f2778078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f278c1ce6a0 0x7f278c1d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c1cdd20 0x7f278c1ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 --2- 172.21.15.135:0/2116741254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f278c0a0af0 0x7f278c0a0ed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 >> 172.21.15.135:0/2116741254 conn(0x7f278c0aaf90 msgr2=0x7f278c0a56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 shutdown_connections 2024-05-09T12:20:32.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.302+0000 7f27913e8640 1 -- 172.21.15.135:0/2116741254 wait complete. 2024-05-09T12:20:32.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 msgr2=0x7f36a00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 0x7f36a00787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006e80 tx=0x7f36b8008040 comp rx=0 tx=0).stop 2024-05-09T12:20:32.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 msgr2=0x7f36bc1d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc1d2140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f36bc076280 tx=0x7f36ac0046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 shutdown_connections 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f36a0076320 0x7f36a00787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36bc133710 0x7f36bc1d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36bc133330 0x7f36bc1d2140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 --2- 172.21.15.135:0/1887529282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36bc0aaae0 0x7f36bc1d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 >> 172.21.15.135:0/1887529282 conn(0x7f36bc0a87a0 msgr2=0x7f36bc1c10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 shutdown_connections 2024-05-09T12:20:32.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.303+0000 7f36c3676640 1 -- 172.21.15.135:0/1887529282 wait complete. 2024-05-09T12:20:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.312+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe0780508d0 con 0x7fe078139b60 2024-05-09T12:20:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.313+0000 7fe05f7fe640 1 -- 172.21.15.135:0/529888853 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0700605b0 con 0x7fe078139b60 2024-05-09T12:20:32.312 INFO:teuthology.orchestra.run.smithi135.stdout:38654705670 2024-05-09T12:20:32.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-05-09T12:20:32.314 DEBUG:teuthology.parallel:result is None 2024-05-09T12:20:32.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-05-09T12:20:32.316 DEBUG:teuthology.parallel:result is None 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 msgr2=0x7fe064078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 0x7fe064078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d440 tx=0x7fe06800f040 comp rx=0 tx=0).stop 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 msgr2=0x7fe07809f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c730 tx=0x7fe07000cbf0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 shutdown_connections 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe0640762d0 0x7fe064078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe078139b60 0x7fe07809f0f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0780a7160 0x7fe07809ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 --2- 172.21.15.135:0/529888853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0780a2960 0x7fe07809e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 >> 172.21.15.135:0/529888853 conn(0x7fe0780aaeb0 msgr2=0x7fe078072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 shutdown_connections 2024-05-09T12:20:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.315+0000 7fe07d227640 1 -- 172.21.15.135:0/529888853 wait complete. 2024-05-09T12:20:32.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-05-09T12:20:32.326 DEBUG:teuthology.parallel:result is None 2024-05-09T12:20:32.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T12:20:32.326 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:32.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 Processor -- start 2024-05-09T12:20:32.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 -- start start 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 0x7f3284073510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f328406e5d0 0x7f328413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840aa000 con 0x7f328413cc20 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f328406eeb0 con 0x7f328406e5d0 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328bbde640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3284139800 con 0x7f328406e1f0 2024-05-09T12:20:32.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f3289179640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f328406e5d0 0x7f328413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f328a17b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f328413cc20 0x7f3284143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:37254/0 (socket says 172.21.15.135:37254) 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.467+0000 7f3289179640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f328406e5d0 0x7f328413c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41210/0 (socket says 172.21.15.135:41210) 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f328a17b640 1 -- 172.21.15.135:0/2856456865 learned_addr learned my addr 172.21.15.135:0/2856456865 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f328997a640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 0x7f3284073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f3289179640 1 -- 172.21.15.135:0/2856456865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 msgr2=0x7f3284073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f3289179640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 0x7f3284073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f3289179640 1 -- 172.21.15.135:0/2856456865 >> v1:172.21.15.135:6789/0 conn(0x7f328413cc20 legacy=0x7f3284143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f3288978640 1 -- 172.21.15.135:0/2856456865 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484372507 0 0) 0x7f32840aa000 con 0x7f328413cc20 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f3289179640 1 -- 172.21.15.135:0/2856456865 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3284139aa0 con 0x7f328406e5d0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.468+0000 7f328997a640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 0x7f3284073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f3289179640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e5d0 0x7f328413c6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32840aa1d0 tx=0x7f327402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382f83e48e3aca7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f3288978640 1 -- 172.21.15.135:0/2856456865 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274039070 con 0x7f328406e5d0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f3288978640 1 -- 172.21.15.135:0/2856456865 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32740316f0 con 0x7f328406e5d0 2024-05-09T12:20:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f3288978640 1 -- 172.21.15.135:0/2856456865 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274031ac0 con 0x7f328406e5d0 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 -- 172.21.15.135:0/2856456865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e5d0 msgr2=0x7f328413c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e5d0 0x7f328413c6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32840aa1d0 tx=0x7f327402b790 comp rx=0 tx=0).stop 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 -- 172.21.15.135:0/2856456865 shutdown_connections 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e5d0 0x7f328413c6e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 --2- 172.21.15.135:0/2856456865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e1f0 0x7f3284073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 -- 172.21.15.135:0/2856456865 >> 172.21.15.135:0/2856456865 conn(0x7f32840ac9c0 msgr2=0x7f32840acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 -- 172.21.15.135:0/2856456865 shutdown_connections 2024-05-09T12:20:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.469+0000 7f328bbde640 1 -- 172.21.15.135:0/2856456865 wait complete. 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.470+0000 7f328bbde640 1 Processor -- start 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.470+0000 7f328bbde640 1 -- start start 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e5d0 0x7f32841cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 0x7f32841d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3284074850 con 0x7f328406e1f0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3284073b20 con 0x7f328413cc20 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32840749d0 con 0x7f328406e5d0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41214/0 (socket says 172.21.15.135:41214) 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 -- 172.21.15.135:0/3275561700 learned_addr learned my addr 172.21.15.135:0/3275561700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328a17b640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 0x7f32841d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f3289179640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e5d0 0x7f32841cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 -- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e5d0 msgr2=0x7f32841cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e5d0 0x7f32841cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 -- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 msgr2=0x7f32841d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 0x7f32841d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 -- 172.21.15.135:0/3275561700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32841256b0 con 0x7f328406e1f0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328a17b640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 0x7f32841d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328997a640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f328000e730 tx=0x7f328000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000f040 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3280004230 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3284124530 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.471+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000ee40 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.472+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32840a8ba0 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.472+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328413aca0 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.473+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f328000c6d0 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.474+0000 7f327a7fc640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 0x7f3268078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.474+0000 7f3289179640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 0x7f3268078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.474+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f3280096d90 con 0x7f328406e1f0 2024-05-09T12:20:32.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.474+0000 7f3289179640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 0x7f3268078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3274036000 tx=0x7f3274008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.478+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3280017020 con 0x7f328406e1f0 2024-05-09T12:20:32.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.655+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32841ce840 con 0x7f32680762d0 2024-05-09T12:20:32.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.661+0000 7f327a7fc640 1 -- 172.21.15.135:0/3275561700 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268525 (secure 0 0 0) 0x7f3274031820 con 0x7f32680762d0 2024-05-09T12:20:32.661 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:32.665 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 msgr2=0x7f3268078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 0x7f3268078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3274036000 tx=0x7f3274008030 comp rx=0 tx=0).stop 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 msgr2=0x7f32841ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f328000e730 tx=0x7f328000ebf0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 shutdown_connections 2024-05-09T12:20:32.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32680762d0 0x7f3268078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f328413cc20 0x7f32841d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f328406e5d0 0x7f32841cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 --2- 172.21.15.135:0/3275561700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f328406e1f0 0x7f32841ceaa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 >> 172.21.15.135:0/3275561700 conn(0x7f32840ac9c0 msgr2=0x7f328406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 shutdown_connections 2024-05-09T12:20:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.664+0000 7f328bbde640 1 -- 172.21.15.135:0/3275561700 wait complete. 2024-05-09T12:20:32.675 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T12:20:31.375688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109952,"kb_used_data":1848,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377408,"statfs":{"total":386547056640,"available":386434465792,"internally_reserved":0,"allocated":1892352,"data_stored":1401356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.757989"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961005+0000","last_change":"2024-05-09T12:20:21.640078+0000","last_active":"2024-05-09T12:20:22.961005+0000","last_peered":"2024-05-09T12:20:22.961005+0000","last_clean":"2024-05-09T12:20:22.961005+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:20:22.961005+0000","last_undegraded":"2024-05-09T12:20:22.961005+0000","last_fullsized":"2024-05-09T12:20:22.961005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633805+0000","last_change":"2024-05-09T12:20:21.640588+0000","last_active":"2024-05-09T12:20:22.633805+0000","last_peered":"2024-05-09T12:20:22.633805+0000","last_clean":"2024-05-09T12:20:22.633805+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:20:22.633805+0000","last_undegraded":"2024-05-09T12:20:22.633805+0000","last_fullsized":"2024-05-09T12:20:22.633805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633146+0000","last_change":"2024-05-09T12:20:21.639557+0000","last_active":"2024-05-09T12:20:22.633146+0000","last_peered":"2024-05-09T12:20:22.633146+0000","last_clean":"2024-05-09T12:20:22.633146+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:20:22.633146+0000","last_undegraded":"2024-05-09T12:20:22.633146+0000","last_fullsized":"2024-05-09T12:20:22.633146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:37.437914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632341+0000","last_change":"2024-05-09T12:20:21.641474+0000","last_active":"2024-05-09T12:20:22.632341+0000","last_peered":"2024-05-09T12:20:22.632341+0000","last_clean":"2024-05-09T12:20:22.632341+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:20:22.632341+0000","last_undegraded":"2024-05-09T12:20:22.632341+0000","last_fullsized":"2024-05-09T12:20:22.632341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960955+0000","last_change":"2024-05-09T12:20:21.641137+0000","last_active":"2024-05-09T12:20:22.960955+0000","last_peered":"2024-05-09T12:20:22.960955+0000","last_clean":"2024-05-09T12:20:22.960955+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:20:22.960955+0000","last_undegraded":"2024-05-09T12:20:22.960955+0000","last_fullsized":"2024-05-09T12:20:22.960955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631841+0000","last_change":"2024-05-09T12:20:21.637744+0000","last_active":"2024-05-09T12:20:22.631841+0000","last_peered":"2024-05-09T12:20:22.631841+0000","last_clean":"2024-05-09T12:20:22.631841+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:20:22.631841+0000","last_undegraded":"2024-05-09T12:20:22.631841+0000","last_fullsized":"2024-05-09T12:20:22.631841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632362+0000","last_change":"2024-05-09T12:20:21.641996+0000","last_active":"2024-05-09T12:20:22.632362+0000","last_peered":"2024-05-09T12:20:22.632362+0000","last_clean":"2024-05-09T12:20:22.632362+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:20:22.632362+0000","last_undegraded":"2024-05-09T12:20:22.632362+0000","last_fullsized":"2024-05-09T12:20:22.632362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632430+0000","last_change":"2024-05-09T12:20:21.637546+0000","last_active":"2024-05-09T12:20:22.632430+0000","last_peered":"2024-05-09T12:20:22.632430+0000","last_clean":"2024-05-09T12:20:22.632430+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:20:22.632430+0000","last_undegraded":"2024-05-09T12:20:22.632430+0000","last_fullsized":"2024-05-09T12:20:22.632430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960747+0000","last_change":"2024-05-09T12:20:21.640522+0000","last_active":"2024-05-09T12:20:22.960747+0000","last_peered":"2024-05-09T12:20:22.960747+0000","last_clean":"2024-05-09T12:20:22.960747+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:20:22.960747+0000","last_undegraded":"2024-05-09T12:20:22.960747+0000","last_fullsized":"2024-05-09T12:20:22.960747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632891+0000","last_change":"2024-05-09T12:20:21.642468+0000","last_active":"2024-05-09T12:20:22.632891+0000","last_peered":"2024-05-09T12:20:22.632891+0000","last_clean":"2024-05-09T12:20:22.632891+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:20:22.632891+0000","last_undegraded":"2024-05-09T12:20:22.632891+0000","last_fullsized":"2024-05-09T12:20:22.632891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633090+0000","last_change":"2024-05-09T12:20:21.634590+0000","last_active":"2024-05-09T12:20:22.633090+0000","last_peered":"2024-05-09T12:20:22.633090+0000","last_clean":"2024-05-09T12:20:22.633090+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:20:22.633090+0000","last_undegraded":"2024-05-09T12:20:22.633090+0000","last_fullsized":"2024-05-09T12:20:22.633090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631426+0000","last_change":"2024-05-09T12:20:21.630566+0000","last_active":"2024-05-09T12:20:22.631426+0000","last_peered":"2024-05-09T12:20:22.631426+0000","last_clean":"2024-05-09T12:20:22.631426+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:20:22.631426+0000","last_undegraded":"2024-05-09T12:20:22.631426+0000","last_fullsized":"2024-05-09T12:20:22.631426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960373+0000","last_change":"2024-05-09T12:20:21.642290+0000","last_active":"2024-05-09T12:20:22.960373+0000","last_peered":"2024-05-09T12:20:22.960373+0000","last_clean":"2024-05-09T12:20:22.960373+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:20:22.960373+0000","last_undegraded":"2024-05-09T12:20:22.960373+0000","last_fullsized":"2024-05-09T12:20:22.960373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631972+0000","last_change":"2024-05-09T12:20:21.636007+0000","last_active":"2024-05-09T12:20:22.631972+0000","last_peered":"2024-05-09T12:20:22.631972+0000","last_clean":"2024-05-09T12:20:22.631972+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:20:22.631972+0000","last_undegraded":"2024-05-09T12:20:22.631972+0000","last_fullsized":"2024-05-09T12:20:22.631972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632535+0000","last_change":"2024-05-09T12:20:21.640762+0000","last_active":"2024-05-09T12:20:22.632535+0000","last_peered":"2024-05-09T12:20:22.632535+0000","last_clean":"2024-05-09T12:20:22.632535+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:20:22.632535+0000","last_undegraded":"2024-05-09T12:20:22.632535+0000","last_fullsized":"2024-05-09T12:20:22.632535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633618+0000","last_change":"2024-05-09T12:20:21.635550+0000","last_active":"2024-05-09T12:20:22.633618+0000","last_peered":"2024-05-09T12:20:22.633618+0000","last_clean":"2024-05-09T12:20:22.633618+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:20:22.633618+0000","last_undegraded":"2024-05-09T12:20:22.633618+0000","last_fullsized":"2024-05-09T12:20:22.633618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:13:25.977279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960675+0000","last_change":"2024-05-09T12:20:21.640922+0000","last_active":"2024-05-09T12:20:22.960675+0000","last_peered":"2024-05-09T12:20:22.960675+0000","last_clean":"2024-05-09T12:20:22.960675+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:20:22.960675+0000","last_undegraded":"2024-05-09T12:20:22.960675+0000","last_fullsized":"2024-05-09T12:20:22.960675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633064+0000","last_change":"2024-05-09T12:20:21.639291+0000","last_active":"2024-05-09T12:20:22.633064+0000","last_peered":"2024-05-09T12:20:22.633064+0000","last_clean":"2024-05-09T12:20:22.633064+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:20:22.633064+0000","last_undegraded":"2024-05-09T12:20:22.633064+0000","last_fullsized":"2024-05-09T12:20:22.633064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:57.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960841+0000","last_change":"2024-05-09T12:20:21.636709+0000","last_active":"2024-05-09T12:20:22.960841+0000","last_peered":"2024-05-09T12:20:22.960841+0000","last_clean":"2024-05-09T12:20:22.960841+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:20:22.960841+0000","last_undegraded":"2024-05-09T12:20:22.960841+0000","last_fullsized":"2024-05-09T12:20:22.960841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632942+0000","last_change":"2024-05-09T12:20:21.637072+0000","last_active":"2024-05-09T12:20:22.632942+0000","last_peered":"2024-05-09T12:20:22.632942+0000","last_clean":"2024-05-09T12:20:22.632942+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:20:22.632942+0000","last_undegraded":"2024-05-09T12:20:22.632942+0000","last_fullsized":"2024-05-09T12:20:22.632942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632736+0000","last_change":"2024-05-09T12:20:21.638705+0000","last_active":"2024-05-09T12:20:22.632736+0000","last_peered":"2024-05-09T12:20:22.632736+0000","last_clean":"2024-05-09T12:20:22.632736+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:20:22.632736+0000","last_undegraded":"2024-05-09T12:20:22.632736+0000","last_fullsized":"2024-05-09T12:20:22.632736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960312+0000","last_change":"2024-05-09T12:20:21.634342+0000","last_active":"2024-05-09T12:20:22.960312+0000","last_peered":"2024-05-09T12:20:22.960312+0000","last_clean":"2024-05-09T12:20:22.960312+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:20:22.960312+0000","last_undegraded":"2024-05-09T12:20:22.960312+0000","last_fullsized":"2024-05-09T12:20:22.960312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631183+0000","last_change":"2024-05-09T12:20:21.637932+0000","last_active":"2024-05-09T12:20:22.631183+0000","last_peered":"2024-05-09T12:20:22.631183+0000","last_clean":"2024-05-09T12:20:22.631183+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:20:22.631183+0000","last_undegraded":"2024-05-09T12:20:22.631183+0000","last_fullsized":"2024-05-09T12:20:22.631183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632621+0000","last_change":"2024-05-09T12:20:21.637783+0000","last_active":"2024-05-09T12:20:22.632621+0000","last_peered":"2024-05-09T12:20:22.632621+0000","last_clean":"2024-05-09T12:20:22.632621+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:20:22.632621+0000","last_undegraded":"2024-05-09T12:20:22.632621+0000","last_fullsized":"2024-05-09T12:20:22.632621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631842+0000","last_change":"2024-05-09T12:20:21.631135+0000","last_active":"2024-05-09T12:20:22.631842+0000","last_peered":"2024-05-09T12:20:22.631842+0000","last_clean":"2024-05-09T12:20:22.631842+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:20:22.631842+0000","last_undegraded":"2024-05-09T12:20:22.631842+0000","last_fullsized":"2024-05-09T12:20:22.631842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631710+0000","last_change":"2024-05-09T12:20:21.634947+0000","last_active":"2024-05-09T12:20:22.631710+0000","last_peered":"2024-05-09T12:20:22.631710+0000","last_clean":"2024-05-09T12:20:22.631710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:20:22.631710+0000","last_undegraded":"2024-05-09T12:20:22.631710+0000","last_fullsized":"2024-05-09T12:20:22.631710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633466+0000","last_change":"2024-05-09T12:20:21.639631+0000","last_active":"2024-05-09T12:20:22.633466+0000","last_peered":"2024-05-09T12:20:22.633466+0000","last_clean":"2024-05-09T12:20:22.633466+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:20:22.633466+0000","last_undegraded":"2024-05-09T12:20:22.633466+0000","last_fullsized":"2024-05-09T12:20:22.633466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:22.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:21.644243+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960667+0000","last_change":"2024-05-09T12:20:21.641857+0000","last_active":"2024-05-09T12:20:22.960667+0000","last_peered":"2024-05-09T12:20:22.960667+0000","last_clean":"2024-05-09T12:20:22.960667+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:20:22.960667+0000","last_undegraded":"2024-05-09T12:20:22.960667+0000","last_fullsized":"2024-05-09T12:20:22.960667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631990+0000","last_change":"2024-05-09T12:20:21.638340+0000","last_active":"2024-05-09T12:20:22.631990+0000","last_peered":"2024-05-09T12:20:22.631990+0000","last_clean":"2024-05-09T12:20:22.631990+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:20:22.631990+0000","last_undegraded":"2024-05-09T12:20:22.631990+0000","last_fullsized":"2024-05-09T12:20:22.631990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631085+0000","last_change":"2024-05-09T12:20:21.634751+0000","last_active":"2024-05-09T12:20:22.631085+0000","last_peered":"2024-05-09T12:20:22.631085+0000","last_clean":"2024-05-09T12:20:22.631085+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:20:22.631085+0000","last_undegraded":"2024-05-09T12:20:22.631085+0000","last_fullsized":"2024-05-09T12:20:22.631085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631736+0000","last_change":"2024-05-09T12:20:21.636322+0000","last_active":"2024-05-09T12:20:22.631736+0000","last_peered":"2024-05-09T12:20:22.631736+0000","last_clean":"2024-05-09T12:20:22.631736+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:20:22.631736+0000","last_undegraded":"2024-05-09T12:20:22.631736+0000","last_fullsized":"2024-05-09T12:20:22.631736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:01.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632003+0000","last_change":"2024-05-09T12:20:21.644274+0000","last_active":"2024-05-09T12:20:22.632003+0000","last_peered":"2024-05-09T12:20:22.632003+0000","last_clean":"2024-05-09T12:20:22.632003+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:20:22.632003+0000","last_undegraded":"2024-05-09T12:20:22.632003+0000","last_fullsized":"2024-05-09T12:20:22.632003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632909+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:20:22.632909+0000","last_peered":"2024-05-09T12:20:22.632909+0000","last_clean":"2024-05-09T12:20:22.632909+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:20:22.632909+0000","last_undegraded":"2024-05-09T12:20:22.632909+0000","last_fullsized":"2024-05-09T12:20:22.632909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633947+0000","last_change":"2024-05-09T12:20:21.644211+0000","last_active":"2024-05-09T12:20:22.633947+0000","last_peered":"2024-05-09T12:20:22.633947+0000","last_clean":"2024-05-09T12:20:22.633947+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:20:22.633947+0000","last_undegraded":"2024-05-09T12:20:22.633947+0000","last_fullsized":"2024-05-09T12:20:22.633947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:14:09.661175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960243+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:20:22.960243+0000","last_peered":"2024-05-09T12:20:22.960243+0000","last_clean":"2024-05-09T12:20:22.960243+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:20:22.960243+0000","last_undegraded":"2024-05-09T12:20:22.960243+0000","last_fullsized":"2024-05-09T12:20:22.960243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960788+0000","last_change":"2024-05-09T12:20:21.636434+0000","last_active":"2024-05-09T12:20:22.960788+0000","last_peered":"2024-05-09T12:20:22.960788+0000","last_clean":"2024-05-09T12:20:22.960788+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:20:22.960788+0000","last_undegraded":"2024-05-09T12:20:22.960788+0000","last_fullsized":"2024-05-09T12:20:22.960788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633456+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:20:22.633456+0000","last_peered":"2024-05-09T12:20:22.633456+0000","last_clean":"2024-05-09T12:20:22.633456+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:20:22.633456+0000","last_undegraded":"2024-05-09T12:20:22.633456+0000","last_fullsized":"2024-05-09T12:20:22.633456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960804+0000","last_change":"2024-05-09T12:20:21.639841+0000","last_active":"2024-05-09T12:20:22.960804+0000","last_peered":"2024-05-09T12:20:22.960804+0000","last_clean":"2024-05-09T12:20:22.960804+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:20:22.960804+0000","last_undegraded":"2024-05-09T12:20:22.960804+0000","last_fullsized":"2024-05-09T12:20:22.960804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633556+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:20:22.633556+0000","last_peered":"2024-05-09T12:20:22.633556+0000","last_clean":"2024-05-09T12:20:22.633556+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:20:22.633556+0000","last_undegraded":"2024-05-09T12:20:22.633556+0000","last_fullsized":"2024-05-09T12:20:22.633556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633459+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:20:22.633459+0000","last_peered":"2024-05-09T12:20:22.633459+0000","last_clean":"2024-05-09T12:20:22.633459+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:20:22.633459+0000","last_undegraded":"2024-05-09T12:20:22.633459+0000","last_fullsized":"2024-05-09T12:20:22.633459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633360+0000","last_change":"2024-05-09T12:20:21.637705+0000","last_active":"2024-05-09T12:20:22.633360+0000","last_peered":"2024-05-09T12:20:22.633360+0000","last_clean":"2024-05-09T12:20:22.633360+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:20:22.633360+0000","last_undegraded":"2024-05-09T12:20:22.633360+0000","last_fullsized":"2024-05-09T12:20:22.633360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.118933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633827+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:20:22.633827+0000","last_peered":"2024-05-09T12:20:22.633827+0000","last_clean":"2024-05-09T12:20:22.633827+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:20:22.633827+0000","last_undegraded":"2024-05-09T12:20:22.633827+0000","last_fullsized":"2024-05-09T12:20:22.633827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632728+0000","last_change":"2024-05-09T12:20:21.641492+0000","last_active":"2024-05-09T12:20:22.632728+0000","last_peered":"2024-05-09T12:20:22.632728+0000","last_clean":"2024-05-09T12:20:22.632728+0000","last_became_active":"2024-05-09T12:20:21.640732+0000","last_became_peered":"2024-05-09T12:20:21.640732+0000","last_unstale":"2024-05-09T12:20:22.632728+0000","last_undegraded":"2024-05-09T12:20:22.632728+0000","last_fullsized":"2024-05-09T12:20:22.632728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633937+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:20:22.633937+0000","last_peered":"2024-05-09T12:20:22.633937+0000","last_clean":"2024-05-09T12:20:22.633937+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:20:22.633937+0000","last_undegraded":"2024-05-09T12:20:22.633937+0000","last_fullsized":"2024-05-09T12:20:22.633937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633355+0000","last_change":"2024-05-09T12:20:21.631032+0000","last_active":"2024-05-09T12:20:22.633355+0000","last_peered":"2024-05-09T12:20:22.633355+0000","last_clean":"2024-05-09T12:20:22.633355+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:20:22.633355+0000","last_undegraded":"2024-05-09T12:20:22.633355+0000","last_fullsized":"2024-05-09T12:20:22.633355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633192+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:20:22.633192+0000","last_peered":"2024-05-09T12:20:22.633192+0000","last_clean":"2024-05-09T12:20:22.633192+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:20:22.633192+0000","last_undegraded":"2024-05-09T12:20:22.633192+0000","last_fullsized":"2024-05-09T12:20:22.633192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960799+0000","last_change":"2024-05-09T12:20:21.641618+0000","last_active":"2024-05-09T12:20:22.960799+0000","last_peered":"2024-05-09T12:20:22.960799+0000","last_clean":"2024-05-09T12:20:22.960799+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:20:22.960799+0000","last_undegraded":"2024-05-09T12:20:22.960799+0000","last_fullsized":"2024-05-09T12:20:22.960799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631757+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:20:22.631757+0000","last_peered":"2024-05-09T12:20:22.631757+0000","last_clean":"2024-05-09T12:20:22.631757+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:20:22.631757+0000","last_undegraded":"2024-05-09T12:20:22.631757+0000","last_fullsized":"2024-05-09T12:20:22.631757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633261+0000","last_change":"2024-05-09T12:20:21.639712+0000","last_active":"2024-05-09T12:20:22.633261+0000","last_peered":"2024-05-09T12:20:22.633261+0000","last_clean":"2024-05-09T12:20:22.633261+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:20:22.633261+0000","last_undegraded":"2024-05-09T12:20:22.633261+0000","last_fullsized":"2024-05-09T12:20:22.633261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:55.515277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632264+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:20:22.632264+0000","last_peered":"2024-05-09T12:20:22.632264+0000","last_clean":"2024-05-09T12:20:22.632264+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:20:22.632264+0000","last_undegraded":"2024-05-09T12:20:22.632264+0000","last_fullsized":"2024-05-09T12:20:22.632264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633552+0000","last_change":"2024-05-09T12:20:21.643678+0000","last_active":"2024-05-09T12:20:22.633552+0000","last_peered":"2024-05-09T12:20:22.633552+0000","last_clean":"2024-05-09T12:20:22.633552+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:20:22.633552+0000","last_undegraded":"2024-05-09T12:20:22.633552+0000","last_fullsized":"2024-05-09T12:20:22.633552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:13.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632484+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:20:22.632484+0000","last_peered":"2024-05-09T12:20:22.632484+0000","last_clean":"2024-05-09T12:20:22.632484+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:20:22.632484+0000","last_undegraded":"2024-05-09T12:20:22.632484+0000","last_fullsized":"2024-05-09T12:20:22.632484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633609+0000","last_change":"2024-05-09T12:20:21.631510+0000","last_active":"2024-05-09T12:20:22.633609+0000","last_peered":"2024-05-09T12:20:22.633609+0000","last_clean":"2024-05-09T12:20:22.633609+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:20:22.633609+0000","last_undegraded":"2024-05-09T12:20:22.633609+0000","last_fullsized":"2024-05-09T12:20:22.633609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631208+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:20:22.631208+0000","last_peered":"2024-05-09T12:20:22.631208+0000","last_clean":"2024-05-09T12:20:22.631208+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:20:22.631208+0000","last_undegraded":"2024-05-09T12:20:22.631208+0000","last_fullsized":"2024-05-09T12:20:22.631208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631983+0000","last_change":"2024-05-09T12:20:21.632437+0000","last_active":"2024-05-09T12:20:22.631983+0000","last_peered":"2024-05-09T12:20:22.631983+0000","last_clean":"2024-05-09T12:20:22.631983+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:20:22.631983+0000","last_undegraded":"2024-05-09T12:20:22.631983+0000","last_fullsized":"2024-05-09T12:20:22.631983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633694+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:22.633694+0000","last_peered":"2024-05-09T12:20:22.633694+0000","last_clean":"2024-05-09T12:20:22.633694+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:22.633694+0000","last_undegraded":"2024-05-09T12:20:22.633694+0000","last_fullsized":"2024-05-09T12:20:22.633694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633830+0000","last_change":"2024-05-09T12:20:21.643674+0000","last_active":"2024-05-09T12:20:22.633830+0000","last_peered":"2024-05-09T12:20:22.633830+0000","last_clean":"2024-05-09T12:20:22.633830+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:20:22.633830+0000","last_undegraded":"2024-05-09T12:20:22.633830+0000","last_fullsized":"2024-05-09T12:20:22.633830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:10.597391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632543+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:22.632543+0000","last_peered":"2024-05-09T12:20:22.632543+0000","last_clean":"2024-05-09T12:20:22.632543+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:22.632543+0000","last_undegraded":"2024-05-09T12:20:22.632543+0000","last_fullsized":"2024-05-09T12:20:22.632543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633165+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:20:22.633165+0000","last_peered":"2024-05-09T12:20:22.633165+0000","last_clean":"2024-05-09T12:20:22.633165+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:20:22.633165+0000","last_undegraded":"2024-05-09T12:20:22.633165+0000","last_fullsized":"2024-05-09T12:20:22.633165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632062+0000","last_change":"2024-05-09T12:20:21.633583+0000","last_active":"2024-05-09T12:20:22.632062+0000","last_peered":"2024-05-09T12:20:22.632062+0000","last_clean":"2024-05-09T12:20:22.632062+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:20:22.632062+0000","last_undegraded":"2024-05-09T12:20:22.632062+0000","last_fullsized":"2024-05-09T12:20:22.632062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632628+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:22.632628+0000","last_peered":"2024-05-09T12:20:22.632628+0000","last_clean":"2024-05-09T12:20:22.632628+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:22.632628+0000","last_undegraded":"2024-05-09T12:20:22.632628+0000","last_fullsized":"2024-05-09T12:20:22.632628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631312+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:20:22.631312+0000","last_peered":"2024-05-09T12:20:22.631312+0000","last_clean":"2024-05-09T12:20:22.631312+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:20:22.631312+0000","last_undegraded":"2024-05-09T12:20:22.631312+0000","last_fullsized":"2024-05-09T12:20:22.631312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632143+0000","last_change":"2024-05-09T12:20:21.632822+0000","last_active":"2024-05-09T12:20:22.632143+0000","last_peered":"2024-05-09T12:20:22.632143+0000","last_clean":"2024-05-09T12:20:22.632143+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:20:22.632143+0000","last_undegraded":"2024-05-09T12:20:22.632143+0000","last_fullsized":"2024-05-09T12:20:22.632143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631884+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:22.631884+0000","last_peered":"2024-05-09T12:20:22.631884+0000","last_clean":"2024-05-09T12:20:22.631884+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:22.631884+0000","last_undegraded":"2024-05-09T12:20:22.631884+0000","last_fullsized":"2024-05-09T12:20:22.631884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633858+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:22.633858+0000","last_peered":"2024-05-09T12:20:22.633858+0000","last_clean":"2024-05-09T12:20:22.633858+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:22.633858+0000","last_undegraded":"2024-05-09T12:20:22.633858+0000","last_fullsized":"2024-05-09T12:20:22.633858+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960462+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:20:22.960462+0000","last_peered":"2024-05-09T12:20:22.960462+0000","last_clean":"2024-05-09T12:20:22.960462+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:20:22.960462+0000","last_undegraded":"2024-05-09T12:20:22.960462+0000","last_fullsized":"2024-05-09T12:20:22.960462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960642+0000","last_change":"2024-05-09T12:20:21.634170+0000","last_active":"2024-05-09T12:20:22.960642+0000","last_peered":"2024-05-09T12:20:22.960642+0000","last_clean":"2024-05-09T12:20:22.960642+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:20:22.960642+0000","last_undegraded":"2024-05-09T12:20:22.960642+0000","last_fullsized":"2024-05-09T12:20:22.960642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:23.629858+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:20:23.629858+0000","last_peered":"2024-05-09T12:20:23.629858+0000","last_clean":"2024-05-09T12:20:23.629858+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:20:23.629858+0000","last_undegraded":"2024-05-09T12:20:23.629858+0000","last_fullsized":"2024-05-09T12:20:23.629858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632132+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:22.632132+0000","last_peered":"2024-05-09T12:20:22.632132+0000","last_clean":"2024-05-09T12:20:22.632132+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:22.632132+0000","last_undegraded":"2024-05-09T12:20:22.632132+0000","last_fullsized":"2024-05-09T12:20:22.632132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632858+0000","last_change":"2024-05-09T12:20:21.631044+0000","last_active":"2024-05-09T12:20:22.632858+0000","last_peered":"2024-05-09T12:20:22.632858+0000","last_clean":"2024-05-09T12:20:22.632858+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:20:22.632858+0000","last_undegraded":"2024-05-09T12:20:22.632858+0000","last_fullsized":"2024-05-09T12:20:22.632858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632267+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:20:22.632267+0000","last_peered":"2024-05-09T12:20:22.632267+0000","last_clean":"2024-05-09T12:20:22.632267+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:20:22.632267+0000","last_undegraded":"2024-05-09T12:20:22.632267+0000","last_fullsized":"2024-05-09T12:20:22.632267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633788+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:22.633788+0000","last_peered":"2024-05-09T12:20:22.633788+0000","last_clean":"2024-05-09T12:20:22.633788+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:22.633788+0000","last_undegraded":"2024-05-09T12:20:22.633788+0000","last_fullsized":"2024-05-09T12:20:22.633788+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960218+0000","last_change":"2024-05-09T12:20:21.636481+0000","last_active":"2024-05-09T12:20:22.960218+0000","last_peered":"2024-05-09T12:20:22.960218+0000","last_clean":"2024-05-09T12:20:22.960218+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:20:22.960218+0000","last_undegraded":"2024-05-09T12:20:22.960218+0000","last_fullsized":"2024-05-09T12:20:22.960218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632105+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:20:22.632105+0000","last_peered":"2024-05-09T12:20:22.632105+0000","last_clean":"2024-05-09T12:20:22.632105+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:20:22.632105+0000","last_undegraded":"2024-05-09T12:20:22.632105+0000","last_fullsized":"2024-05-09T12:20:22.632105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633121+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:22.633121+0000","last_peered":"2024-05-09T12:20:22.633121+0000","last_clean":"2024-05-09T12:20:22.633121+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:22.633121+0000","last_undegraded":"2024-05-09T12:20:22.633121+0000","last_fullsized":"2024-05-09T12:20:22.633121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961013+0000","last_change":"2024-05-09T12:20:21.641170+0000","last_active":"2024-05-09T12:20:22.961013+0000","last_peered":"2024-05-09T12:20:22.961013+0000","last_clean":"2024-05-09T12:20:22.961013+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:20:22.961013+0000","last_undegraded":"2024-05-09T12:20:22.961013+0000","last_fullsized":"2024-05-09T12:20:22.961013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633653+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:20:22.633653+0000","last_peered":"2024-05-09T12:20:22.633653+0000","last_clean":"2024-05-09T12:20:22.633653+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:20:22.633653+0000","last_undegraded":"2024-05-09T12:20:22.633653+0000","last_fullsized":"2024-05-09T12:20:22.633653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633735+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:22.633735+0000","last_peered":"2024-05-09T12:20:22.633735+0000","last_clean":"2024-05-09T12:20:22.633735+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:22.633735+0000","last_undegraded":"2024-05-09T12:20:22.633735+0000","last_fullsized":"2024-05-09T12:20:22.633735+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631463+0000","last_change":"2024-05-09T12:20:21.630541+0000","last_active":"2024-05-09T12:20:22.631463+0000","last_peered":"2024-05-09T12:20:22.631463+0000","last_clean":"2024-05-09T12:20:22.631463+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:20:22.631463+0000","last_undegraded":"2024-05-09T12:20:22.631463+0000","last_fullsized":"2024-05-09T12:20:22.631463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633063+0000","last_change":"2024-05-09T12:20:21.630924+0000","last_active":"2024-05-09T12:20:22.633063+0000","last_peered":"2024-05-09T12:20:22.633063+0000","last_clean":"2024-05-09T12:20:22.633063+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:20:22.633063+0000","last_undegraded":"2024-05-09T12:20:22.633063+0000","last_fullsized":"2024-05-09T12:20:22.633063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633061+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:20:22.633061+0000","last_peered":"2024-05-09T12:20:22.633061+0000","last_clean":"2024-05-09T12:20:22.633061+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:20:22.633061+0000","last_undegraded":"2024-05-09T12:20:22.633061+0000","last_fullsized":"2024-05-09T12:20:22.633061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631908+0000","last_change":"2024-05-09T12:20:21.635202+0000","last_active":"2024-05-09T12:20:22.631908+0000","last_peered":"2024-05-09T12:20:22.631908+0000","last_clean":"2024-05-09T12:20:22.631908+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:20:22.631908+0000","last_undegraded":"2024-05-09T12:20:22.631908+0000","last_fullsized":"2024-05-09T12:20:22.631908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633873+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:20:22.633873+0000","last_peered":"2024-05-09T12:20:22.633873+0000","last_clean":"2024-05-09T12:20:22.633873+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:20:22.633873+0000","last_undegraded":"2024-05-09T12:20:22.633873+0000","last_fullsized":"2024-05-09T12:20:22.633873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633713+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:20:22.633713+0000","last_peered":"2024-05-09T12:20:22.633713+0000","last_clean":"2024-05-09T12:20:22.633713+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:20:22.633713+0000","last_undegraded":"2024-05-09T12:20:22.633713+0000","last_fullsized":"2024-05-09T12:20:22.633713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960371+0000","last_change":"2024-05-09T12:20:21.633256+0000","last_active":"2024-05-09T12:20:22.960371+0000","last_peered":"2024-05-09T12:20:22.960371+0000","last_clean":"2024-05-09T12:20:22.960371+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:20:22.960371+0000","last_undegraded":"2024-05-09T12:20:22.960371+0000","last_fullsized":"2024-05-09T12:20:22.960371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960984+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:20:22.960984+0000","last_peered":"2024-05-09T12:20:22.960984+0000","last_clean":"2024-05-09T12:20:22.960984+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:20:22.960984+0000","last_undegraded":"2024-05-09T12:20:22.960984+0000","last_fullsized":"2024-05-09T12:20:22.960984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631089+0000","last_change":"2024-05-09T12:20:21.635653+0000","last_active":"2024-05-09T12:20:22.631089+0000","last_peered":"2024-05-09T12:20:22.631089+0000","last_clean":"2024-05-09T12:20:22.631089+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:20:22.631089+0000","last_undegraded":"2024-05-09T12:20:22.631089+0000","last_fullsized":"2024-05-09T12:20:22.631089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633343+0000","last_change":"2024-05-09T12:20:21.644065+0000","last_active":"2024-05-09T12:20:22.633343+0000","last_peered":"2024-05-09T12:20:22.633343+0000","last_clean":"2024-05-09T12:20:22.633343+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:20:22.633343+0000","last_undegraded":"2024-05-09T12:20:22.633343+0000","last_fullsized":"2024-05-09T12:20:22.633343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:33.210315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631220+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:20:22.631220+0000","last_peered":"2024-05-09T12:20:22.631220+0000","last_clean":"2024-05-09T12:20:22.631220+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:20:22.631220+0000","last_undegraded":"2024-05-09T12:20:22.631220+0000","last_fullsized":"2024-05-09T12:20:22.631220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960567+0000","last_change":"2024-05-09T12:20:21.633601+0000","last_active":"2024-05-09T12:20:22.960567+0000","last_peered":"2024-05-09T12:20:22.960567+0000","last_clean":"2024-05-09T12:20:22.960567+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:20:22.960567+0000","last_undegraded":"2024-05-09T12:20:22.960567+0000","last_fullsized":"2024-05-09T12:20:22.960567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631280+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:20:22.631280+0000","last_peered":"2024-05-09T12:20:22.631280+0000","last_clean":"2024-05-09T12:20:22.631280+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:20:22.631280+0000","last_undegraded":"2024-05-09T12:20:22.631280+0000","last_fullsized":"2024-05-09T12:20:22.631280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960921+0000","last_change":"2024-05-09T12:20:21.638359+0000","last_active":"2024-05-09T12:20:22.960921+0000","last_peered":"2024-05-09T12:20:22.960921+0000","last_clean":"2024-05-09T12:20:22.960921+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:20:22.960921+0000","last_undegraded":"2024-05-09T12:20:22.960921+0000","last_fullsized":"2024-05-09T12:20:22.960921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632563+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:20:22.632563+0000","last_peered":"2024-05-09T12:20:22.632563+0000","last_clean":"2024-05-09T12:20:22.632563+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:20:22.632563+0000","last_undegraded":"2024-05-09T12:20:22.632563+0000","last_fullsized":"2024-05-09T12:20:22.632563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631862+0000","last_change":"2024-05-09T12:20:21.634182+0000","last_active":"2024-05-09T12:20:22.631862+0000","last_peered":"2024-05-09T12:20:22.631862+0000","last_clean":"2024-05-09T12:20:22.631862+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:20:22.631862+0000","last_undegraded":"2024-05-09T12:20:22.631862+0000","last_fullsized":"2024-05-09T12:20:22.631862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961067+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:20:22.961067+0000","last_peered":"2024-05-09T12:20:22.961067+0000","last_clean":"2024-05-09T12:20:22.961067+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:20:22.961067+0000","last_undegraded":"2024-05-09T12:20:22.961067+0000","last_fullsized":"2024-05-09T12:20:22.961067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633289+0000","last_change":"2024-05-09T12:20:21.638295+0000","last_active":"2024-05-09T12:20:22.633289+0000","last_peered":"2024-05-09T12:20:22.633289+0000","last_clean":"2024-05-09T12:20:22.633289+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:20:22.633289+0000","last_undegraded":"2024-05-09T12:20:22.633289+0000","last_fullsized":"2024-05-09T12:20:22.633289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632470+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:20:22.632470+0000","last_peered":"2024-05-09T12:20:22.632470+0000","last_clean":"2024-05-09T12:20:22.632470+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:20:22.632470+0000","last_undegraded":"2024-05-09T12:20:22.632470+0000","last_fullsized":"2024-05-09T12:20:22.632470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632133+0000","last_change":"2024-05-09T12:20:21.642394+0000","last_active":"2024-05-09T12:20:22.632133+0000","last_peered":"2024-05-09T12:20:22.632133+0000","last_clean":"2024-05-09T12:20:22.632133+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:20:22.632133+0000","last_undegraded":"2024-05-09T12:20:22.632133+0000","last_fullsized":"2024-05-09T12:20:22.632133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633690+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:20:22.633690+0000","last_peered":"2024-05-09T12:20:22.633690+0000","last_clean":"2024-05-09T12:20:22.633690+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:20:22.633690+0000","last_undegraded":"2024-05-09T12:20:22.633690+0000","last_fullsized":"2024-05-09T12:20:22.633690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960335+0000","last_change":"2024-05-09T12:20:21.634325+0000","last_active":"2024-05-09T12:20:22.960335+0000","last_peered":"2024-05-09T12:20:22.960335+0000","last_clean":"2024-05-09T12:20:22.960335+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:20:22.960335+0000","last_undegraded":"2024-05-09T12:20:22.960335+0000","last_fullsized":"2024-05-09T12:20:22.960335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960858+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:20:22.960858+0000","last_peered":"2024-05-09T12:20:22.960858+0000","last_clean":"2024-05-09T12:20:22.960858+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:20:22.960858+0000","last_undegraded":"2024-05-09T12:20:22.960858+0000","last_fullsized":"2024-05-09T12:20:22.960858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631969+0000","last_change":"2024-05-09T12:20:21.638597+0000","last_active":"2024-05-09T12:20:22.631969+0000","last_peered":"2024-05-09T12:20:22.631969+0000","last_clean":"2024-05-09T12:20:22.631969+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:20:22.631969+0000","last_undegraded":"2024-05-09T12:20:22.631969+0000","last_fullsized":"2024-05-09T12:20:22.631969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960843+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:20:22.960843+0000","last_peered":"2024-05-09T12:20:22.960843+0000","last_clean":"2024-05-09T12:20:22.960843+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:20:22.960843+0000","last_undegraded":"2024-05-09T12:20:22.960843+0000","last_fullsized":"2024-05-09T12:20:22.960843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":646638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":55708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":644318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":54692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:32.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:20:32.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.817+0000 7fa20bf9f640 1 Processor -- start 2024-05-09T12:20:32.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.817+0000 7fa20bf9f640 1 -- start start 2024-05-09T12:20:32.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20bf9f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 0x7fa204139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20bf9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa204073440 0x7fa20413c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20bf9f640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20406d870 con 0x7fa20413cb40 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20bf9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa204073d50 con 0x7fa204073440 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20bf9f640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fa204072890 con 0x7fa204139860 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa204073440 0x7fa20413c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa204073440 0x7fa20413c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51420/0 (socket says 172.21.15.135:51420) 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 -- 172.21.15.135:0/3597101809 learned_addr learned my addr 172.21.15.135:0/3597101809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 -- 172.21.15.135:0/3597101809 >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 msgr2=0x7fa204139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa209d3b640 1 --2- 172.21.15.135:0/3597101809 >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 0x7fa204139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 --2- 172.21.15.135:0/3597101809 >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 0x7fa204139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 -- 172.21.15.135:0/3597101809 >> v1:172.21.15.160:6789/0 conn(0x7fa20413cb40 legacy=0x7fa204143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa20953a640 1 -- 172.21.15.135:0/3597101809 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa204073a90 con 0x7fa204073440 2024-05-09T12:20:32.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.818+0000 7fa209d3b640 1 --2- 172.21.15.135:0/3597101809 >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 0x7fa204139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20953a640 1 --2- 172.21.15.135:0/3597101809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204073440 0x7fa20413c600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa20406ed90 tx=0x7fa1f402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100f659805707810 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa208d39640 1 -- 172.21.15.135:0/3597101809 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4038070 con 0x7fa204073440 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa208d39640 1 -- 172.21.15.135:0/3597101809 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f4031740 con 0x7fa204073440 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa208d39640 1 -- 172.21.15.135:0/3597101809 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402f050 con 0x7fa204073440 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 -- 172.21.15.135:0/3597101809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204073440 msgr2=0x7fa20413c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/3597101809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204073440 0x7fa20413c600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa20406ed90 tx=0x7fa1f402b7e0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 -- 172.21.15.135:0/3597101809 shutdown_connections 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/3597101809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa204073440 0x7fa20413c600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/3597101809 >> v2:172.21.15.160:3300/0 conn(0x7fa204139860 0x7fa204139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.819+0000 7fa20bf9f640 1 -- 172.21.15.135:0/3597101809 >> 172.21.15.135:0/3597101809 conn(0x7fa2040ac9c0 msgr2=0x7fa2040acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.820+0000 7fa20bf9f640 1 -- 172.21.15.135:0/3597101809 shutdown_connections 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.820+0000 7fa20bf9f640 1 -- 172.21.15.135:0/3597101809 wait complete. 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.820+0000 7fa20bf9f640 1 Processor -- start 2024-05-09T12:20:32.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.820+0000 7fa20bf9f640 1 -- start start 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa204073440 0x7fa204134550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa204139860 0x7fa204134a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2040747c0 con 0x7fa20413cb40 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa204072e60 con 0x7fa204073440 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20bf9f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa204074940 con 0x7fa204139860 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51434/0 (socket says 172.21.15.135:51434) 2024-05-09T12:20:32.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 -- 172.21.15.135:0/2342831452 learned_addr learned my addr 172.21.15.135:0/2342831452 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa209d3b640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa204073440 0x7fa204134550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20953a640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa204139860 0x7fa204134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 -- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa204139860 msgr2=0x7fa204134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa204139860 0x7fa204134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 -- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa204073440 msgr2=0x7fa204134550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa204073440 0x7fa204134550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 -- 172.21.15.135:0/2342831452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040a5740 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.821+0000 7fa20a53c640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b970 tx=0x7fa1fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.822+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc019070 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.822+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00cb40 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.822+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2040a7490 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.822+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc014440 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.822+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2040a7750 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.823+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2040a7990 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.823+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1fc01c070 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.824+0000 7fa1fa7fc640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 0x7fa1e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.824+0000 7fa209d3b640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 0x7fa1e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.824+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fa1fc096b10 con 0x7fa20413cb40 2024-05-09T12:20:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.824+0000 7fa209d3b640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 0x7fa1e8078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa20000ab60 tx=0x7fa200008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:32.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:32.828+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1fc060410 con 0x7fa20413cb40 2024-05-09T12:20:33.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.005+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2040508d0 con 0x7fa1e80762d0 2024-05-09T12:20:33.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.011+0000 7fa1fa7fc640 1 -- 172.21.15.135:0/2342831452 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+268525 (secure 0 0 0) 0x7fa2040508d0 con 0x7fa1e80762d0 2024-05-09T12:20:33.011 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:33.019 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:20:33.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 msgr2=0x7fa1e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 0x7fa1e8078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa20000ab60 tx=0x7fa200008040 comp rx=0 tx=0).stop 2024-05-09T12:20:33.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 msgr2=0x7fa2041d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b970 tx=0x7fa1fc00be30 comp rx=0 tx=0).stop 2024-05-09T12:20:33.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 shutdown_connections 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1e80762d0 0x7fa1e8078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa20413cb40 0x7fa2041d1e40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa204139860 0x7fa204134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 --2- 172.21.15.135:0/2342831452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa204073440 0x7fa204134550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 >> 172.21.15.135:0/2342831452 conn(0x7fa2040ac9c0 msgr2=0x7fa204135460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 shutdown_connections 2024-05-09T12:20:33.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.014+0000 7fa20bf9f640 1 -- 172.21.15.135:0/2342831452 wait complete. 2024-05-09T12:20:33.025 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T12:20:31.375688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109952,"kb_used_data":1848,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377408,"statfs":{"total":386547056640,"available":386434465792,"internally_reserved":0,"allocated":1892352,"data_stored":1401356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.757989"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961005+0000","last_change":"2024-05-09T12:20:21.640078+0000","last_active":"2024-05-09T12:20:22.961005+0000","last_peered":"2024-05-09T12:20:22.961005+0000","last_clean":"2024-05-09T12:20:22.961005+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:20:22.961005+0000","last_undegraded":"2024-05-09T12:20:22.961005+0000","last_fullsized":"2024-05-09T12:20:22.961005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633805+0000","last_change":"2024-05-09T12:20:21.640588+0000","last_active":"2024-05-09T12:20:22.633805+0000","last_peered":"2024-05-09T12:20:22.633805+0000","last_clean":"2024-05-09T12:20:22.633805+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:20:22.633805+0000","last_undegraded":"2024-05-09T12:20:22.633805+0000","last_fullsized":"2024-05-09T12:20:22.633805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633146+0000","last_change":"2024-05-09T12:20:21.639557+0000","last_active":"2024-05-09T12:20:22.633146+0000","last_peered":"2024-05-09T12:20:22.633146+0000","last_clean":"2024-05-09T12:20:22.633146+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:20:22.633146+0000","last_undegraded":"2024-05-09T12:20:22.633146+0000","last_fullsized":"2024-05-09T12:20:22.633146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:37.437914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632341+0000","last_change":"2024-05-09T12:20:21.641474+0000","last_active":"2024-05-09T12:20:22.632341+0000","last_peered":"2024-05-09T12:20:22.632341+0000","last_clean":"2024-05-09T12:20:22.632341+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:20:22.632341+0000","last_undegraded":"2024-05-09T12:20:22.632341+0000","last_fullsized":"2024-05-09T12:20:22.632341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960955+0000","last_change":"2024-05-09T12:20:21.641137+0000","last_active":"2024-05-09T12:20:22.960955+0000","last_peered":"2024-05-09T12:20:22.960955+0000","last_clean":"2024-05-09T12:20:22.960955+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:20:22.960955+0000","last_undegraded":"2024-05-09T12:20:22.960955+0000","last_fullsized":"2024-05-09T12:20:22.960955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631841+0000","last_change":"2024-05-09T12:20:21.637744+0000","last_active":"2024-05-09T12:20:22.631841+0000","last_peered":"2024-05-09T12:20:22.631841+0000","last_clean":"2024-05-09T12:20:22.631841+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:20:22.631841+0000","last_undegraded":"2024-05-09T12:20:22.631841+0000","last_fullsized":"2024-05-09T12:20:22.631841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632362+0000","last_change":"2024-05-09T12:20:21.641996+0000","last_active":"2024-05-09T12:20:22.632362+0000","last_peered":"2024-05-09T12:20:22.632362+0000","last_clean":"2024-05-09T12:20:22.632362+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:20:22.632362+0000","last_undegraded":"2024-05-09T12:20:22.632362+0000","last_fullsized":"2024-05-09T12:20:22.632362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632430+0000","last_change":"2024-05-09T12:20:21.637546+0000","last_active":"2024-05-09T12:20:22.632430+0000","last_peered":"2024-05-09T12:20:22.632430+0000","last_clean":"2024-05-09T12:20:22.632430+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:20:22.632430+0000","last_undegraded":"2024-05-09T12:20:22.632430+0000","last_fullsized":"2024-05-09T12:20:22.632430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960747+0000","last_change":"2024-05-09T12:20:21.640522+0000","last_active":"2024-05-09T12:20:22.960747+0000","last_peered":"2024-05-09T12:20:22.960747+0000","last_clean":"2024-05-09T12:20:22.960747+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:20:22.960747+0000","last_undegraded":"2024-05-09T12:20:22.960747+0000","last_fullsized":"2024-05-09T12:20:22.960747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632891+0000","last_change":"2024-05-09T12:20:21.642468+0000","last_active":"2024-05-09T12:20:22.632891+0000","last_peered":"2024-05-09T12:20:22.632891+0000","last_clean":"2024-05-09T12:20:22.632891+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:20:22.632891+0000","last_undegraded":"2024-05-09T12:20:22.632891+0000","last_fullsized":"2024-05-09T12:20:22.632891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:57:44.969850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633090+0000","last_change":"2024-05-09T12:20:21.634590+0000","last_active":"2024-05-09T12:20:22.633090+0000","last_peered":"2024-05-09T12:20:22.633090+0000","last_clean":"2024-05-09T12:20:22.633090+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:20:22.633090+0000","last_undegraded":"2024-05-09T12:20:22.633090+0000","last_fullsized":"2024-05-09T12:20:22.633090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631426+0000","last_change":"2024-05-09T12:20:21.630566+0000","last_active":"2024-05-09T12:20:22.631426+0000","last_peered":"2024-05-09T12:20:22.631426+0000","last_clean":"2024-05-09T12:20:22.631426+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:20:22.631426+0000","last_undegraded":"2024-05-09T12:20:22.631426+0000","last_fullsized":"2024-05-09T12:20:22.631426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960373+0000","last_change":"2024-05-09T12:20:21.642290+0000","last_active":"2024-05-09T12:20:22.960373+0000","last_peered":"2024-05-09T12:20:22.960373+0000","last_clean":"2024-05-09T12:20:22.960373+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:20:22.960373+0000","last_undegraded":"2024-05-09T12:20:22.960373+0000","last_fullsized":"2024-05-09T12:20:22.960373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631972+0000","last_change":"2024-05-09T12:20:21.636007+0000","last_active":"2024-05-09T12:20:22.631972+0000","last_peered":"2024-05-09T12:20:22.631972+0000","last_clean":"2024-05-09T12:20:22.631972+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:20:22.631972+0000","last_undegraded":"2024-05-09T12:20:22.631972+0000","last_fullsized":"2024-05-09T12:20:22.631972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632535+0000","last_change":"2024-05-09T12:20:21.640762+0000","last_active":"2024-05-09T12:20:22.632535+0000","last_peered":"2024-05-09T12:20:22.632535+0000","last_clean":"2024-05-09T12:20:22.632535+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:20:22.632535+0000","last_undegraded":"2024-05-09T12:20:22.632535+0000","last_fullsized":"2024-05-09T12:20:22.632535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633618+0000","last_change":"2024-05-09T12:20:21.635550+0000","last_active":"2024-05-09T12:20:22.633618+0000","last_peered":"2024-05-09T12:20:22.633618+0000","last_clean":"2024-05-09T12:20:22.633618+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:20:22.633618+0000","last_undegraded":"2024-05-09T12:20:22.633618+0000","last_fullsized":"2024-05-09T12:20:22.633618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:13:25.977279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960675+0000","last_change":"2024-05-09T12:20:21.640922+0000","last_active":"2024-05-09T12:20:22.960675+0000","last_peered":"2024-05-09T12:20:22.960675+0000","last_clean":"2024-05-09T12:20:22.960675+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:20:22.960675+0000","last_undegraded":"2024-05-09T12:20:22.960675+0000","last_fullsized":"2024-05-09T12:20:22.960675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633064+0000","last_change":"2024-05-09T12:20:21.639291+0000","last_active":"2024-05-09T12:20:22.633064+0000","last_peered":"2024-05-09T12:20:22.633064+0000","last_clean":"2024-05-09T12:20:22.633064+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:20:22.633064+0000","last_undegraded":"2024-05-09T12:20:22.633064+0000","last_fullsized":"2024-05-09T12:20:22.633064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:57.629929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960841+0000","last_change":"2024-05-09T12:20:21.636709+0000","last_active":"2024-05-09T12:20:22.960841+0000","last_peered":"2024-05-09T12:20:22.960841+0000","last_clean":"2024-05-09T12:20:22.960841+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:20:22.960841+0000","last_undegraded":"2024-05-09T12:20:22.960841+0000","last_fullsized":"2024-05-09T12:20:22.960841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632942+0000","last_change":"2024-05-09T12:20:21.637072+0000","last_active":"2024-05-09T12:20:22.632942+0000","last_peered":"2024-05-09T12:20:22.632942+0000","last_clean":"2024-05-09T12:20:22.632942+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:20:22.632942+0000","last_undegraded":"2024-05-09T12:20:22.632942+0000","last_fullsized":"2024-05-09T12:20:22.632942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632736+0000","last_change":"2024-05-09T12:20:21.638705+0000","last_active":"2024-05-09T12:20:22.632736+0000","last_peered":"2024-05-09T12:20:22.632736+0000","last_clean":"2024-05-09T12:20:22.632736+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:20:22.632736+0000","last_undegraded":"2024-05-09T12:20:22.632736+0000","last_fullsized":"2024-05-09T12:20:22.632736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960312+0000","last_change":"2024-05-09T12:20:21.634342+0000","last_active":"2024-05-09T12:20:22.960312+0000","last_peered":"2024-05-09T12:20:22.960312+0000","last_clean":"2024-05-09T12:20:22.960312+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:20:22.960312+0000","last_undegraded":"2024-05-09T12:20:22.960312+0000","last_fullsized":"2024-05-09T12:20:22.960312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631183+0000","last_change":"2024-05-09T12:20:21.637932+0000","last_active":"2024-05-09T12:20:22.631183+0000","last_peered":"2024-05-09T12:20:22.631183+0000","last_clean":"2024-05-09T12:20:22.631183+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:20:22.631183+0000","last_undegraded":"2024-05-09T12:20:22.631183+0000","last_fullsized":"2024-05-09T12:20:22.631183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632621+0000","last_change":"2024-05-09T12:20:21.637783+0000","last_active":"2024-05-09T12:20:22.632621+0000","last_peered":"2024-05-09T12:20:22.632621+0000","last_clean":"2024-05-09T12:20:22.632621+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:20:22.632621+0000","last_undegraded":"2024-05-09T12:20:22.632621+0000","last_fullsized":"2024-05-09T12:20:22.632621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:48:18.668475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631842+0000","last_change":"2024-05-09T12:20:21.631135+0000","last_active":"2024-05-09T12:20:22.631842+0000","last_peered":"2024-05-09T12:20:22.631842+0000","last_clean":"2024-05-09T12:20:22.631842+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:20:22.631842+0000","last_undegraded":"2024-05-09T12:20:22.631842+0000","last_fullsized":"2024-05-09T12:20:22.631842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631710+0000","last_change":"2024-05-09T12:20:21.634947+0000","last_active":"2024-05-09T12:20:22.631710+0000","last_peered":"2024-05-09T12:20:22.631710+0000","last_clean":"2024-05-09T12:20:22.631710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:20:22.631710+0000","last_undegraded":"2024-05-09T12:20:22.631710+0000","last_fullsized":"2024-05-09T12:20:22.631710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633466+0000","last_change":"2024-05-09T12:20:21.639631+0000","last_active":"2024-05-09T12:20:22.633466+0000","last_peered":"2024-05-09T12:20:22.633466+0000","last_clean":"2024-05-09T12:20:22.633466+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:20:22.633466+0000","last_undegraded":"2024-05-09T12:20:22.633466+0000","last_fullsized":"2024-05-09T12:20:22.633466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:22.637987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:21.644243+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960667+0000","last_change":"2024-05-09T12:20:21.641857+0000","last_active":"2024-05-09T12:20:22.960667+0000","last_peered":"2024-05-09T12:20:22.960667+0000","last_clean":"2024-05-09T12:20:22.960667+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:20:22.960667+0000","last_undegraded":"2024-05-09T12:20:22.960667+0000","last_fullsized":"2024-05-09T12:20:22.960667+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631990+0000","last_change":"2024-05-09T12:20:21.638340+0000","last_active":"2024-05-09T12:20:22.631990+0000","last_peered":"2024-05-09T12:20:22.631990+0000","last_clean":"2024-05-09T12:20:22.631990+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:20:22.631990+0000","last_undegraded":"2024-05-09T12:20:22.631990+0000","last_fullsized":"2024-05-09T12:20:22.631990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631085+0000","last_change":"2024-05-09T12:20:21.634751+0000","last_active":"2024-05-09T12:20:22.631085+0000","last_peered":"2024-05-09T12:20:22.631085+0000","last_clean":"2024-05-09T12:20:22.631085+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:20:22.631085+0000","last_undegraded":"2024-05-09T12:20:22.631085+0000","last_fullsized":"2024-05-09T12:20:22.631085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631736+0000","last_change":"2024-05-09T12:20:21.636322+0000","last_active":"2024-05-09T12:20:22.631736+0000","last_peered":"2024-05-09T12:20:22.631736+0000","last_clean":"2024-05-09T12:20:22.631736+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:20:22.631736+0000","last_undegraded":"2024-05-09T12:20:22.631736+0000","last_fullsized":"2024-05-09T12:20:22.631736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:01.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632003+0000","last_change":"2024-05-09T12:20:21.644274+0000","last_active":"2024-05-09T12:20:22.632003+0000","last_peered":"2024-05-09T12:20:22.632003+0000","last_clean":"2024-05-09T12:20:22.632003+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:20:22.632003+0000","last_undegraded":"2024-05-09T12:20:22.632003+0000","last_fullsized":"2024-05-09T12:20:22.632003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632909+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:20:22.632909+0000","last_peered":"2024-05-09T12:20:22.632909+0000","last_clean":"2024-05-09T12:20:22.632909+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:20:22.632909+0000","last_undegraded":"2024-05-09T12:20:22.632909+0000","last_fullsized":"2024-05-09T12:20:22.632909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633947+0000","last_change":"2024-05-09T12:20:21.644211+0000","last_active":"2024-05-09T12:20:22.633947+0000","last_peered":"2024-05-09T12:20:22.633947+0000","last_clean":"2024-05-09T12:20:22.633947+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:20:22.633947+0000","last_undegraded":"2024-05-09T12:20:22.633947+0000","last_fullsized":"2024-05-09T12:20:22.633947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:14:09.661175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960243+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:20:22.960243+0000","last_peered":"2024-05-09T12:20:22.960243+0000","last_clean":"2024-05-09T12:20:22.960243+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:20:22.960243+0000","last_undegraded":"2024-05-09T12:20:22.960243+0000","last_fullsized":"2024-05-09T12:20:22.960243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960788+0000","last_change":"2024-05-09T12:20:21.636434+0000","last_active":"2024-05-09T12:20:22.960788+0000","last_peered":"2024-05-09T12:20:22.960788+0000","last_clean":"2024-05-09T12:20:22.960788+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:20:22.960788+0000","last_undegraded":"2024-05-09T12:20:22.960788+0000","last_fullsized":"2024-05-09T12:20:22.960788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633456+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:20:22.633456+0000","last_peered":"2024-05-09T12:20:22.633456+0000","last_clean":"2024-05-09T12:20:22.633456+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:20:22.633456+0000","last_undegraded":"2024-05-09T12:20:22.633456+0000","last_fullsized":"2024-05-09T12:20:22.633456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960804+0000","last_change":"2024-05-09T12:20:21.639841+0000","last_active":"2024-05-09T12:20:22.960804+0000","last_peered":"2024-05-09T12:20:22.960804+0000","last_clean":"2024-05-09T12:20:22.960804+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:20:22.960804+0000","last_undegraded":"2024-05-09T12:20:22.960804+0000","last_fullsized":"2024-05-09T12:20:22.960804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633556+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:20:22.633556+0000","last_peered":"2024-05-09T12:20:22.633556+0000","last_clean":"2024-05-09T12:20:22.633556+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:20:22.633556+0000","last_undegraded":"2024-05-09T12:20:22.633556+0000","last_fullsized":"2024-05-09T12:20:22.633556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633459+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:20:22.633459+0000","last_peered":"2024-05-09T12:20:22.633459+0000","last_clean":"2024-05-09T12:20:22.633459+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:20:22.633459+0000","last_undegraded":"2024-05-09T12:20:22.633459+0000","last_fullsized":"2024-05-09T12:20:22.633459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633360+0000","last_change":"2024-05-09T12:20:21.637705+0000","last_active":"2024-05-09T12:20:22.633360+0000","last_peered":"2024-05-09T12:20:22.633360+0000","last_clean":"2024-05-09T12:20:22.633360+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:20:22.633360+0000","last_undegraded":"2024-05-09T12:20:22.633360+0000","last_fullsized":"2024-05-09T12:20:22.633360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.118933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633827+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:20:22.633827+0000","last_peered":"2024-05-09T12:20:22.633827+0000","last_clean":"2024-05-09T12:20:22.633827+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:20:22.633827+0000","last_undegraded":"2024-05-09T12:20:22.633827+0000","last_fullsized":"2024-05-09T12:20:22.633827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632728+0000","last_change":"2024-05-09T12:20:21.641492+0000","last_active":"2024-05-09T12:20:22.632728+0000","last_peered":"2024-05-09T12:20:22.632728+0000","last_clean":"2024-05-09T12:20:22.632728+0000","last_became_active":"2024-05-09T12:20:21.640732+0000","last_became_peered":"2024-05-09T12:20:21.640732+0000","last_unstale":"2024-05-09T12:20:22.632728+0000","last_undegraded":"2024-05-09T12:20:22.632728+0000","last_fullsized":"2024-05-09T12:20:22.632728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633937+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:20:22.633937+0000","last_peered":"2024-05-09T12:20:22.633937+0000","last_clean":"2024-05-09T12:20:22.633937+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:20:22.633937+0000","last_undegraded":"2024-05-09T12:20:22.633937+0000","last_fullsized":"2024-05-09T12:20:22.633937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633355+0000","last_change":"2024-05-09T12:20:21.631032+0000","last_active":"2024-05-09T12:20:22.633355+0000","last_peered":"2024-05-09T12:20:22.633355+0000","last_clean":"2024-05-09T12:20:22.633355+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:20:22.633355+0000","last_undegraded":"2024-05-09T12:20:22.633355+0000","last_fullsized":"2024-05-09T12:20:22.633355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633192+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:20:22.633192+0000","last_peered":"2024-05-09T12:20:22.633192+0000","last_clean":"2024-05-09T12:20:22.633192+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:20:22.633192+0000","last_undegraded":"2024-05-09T12:20:22.633192+0000","last_fullsized":"2024-05-09T12:20:22.633192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960799+0000","last_change":"2024-05-09T12:20:21.641618+0000","last_active":"2024-05-09T12:20:22.960799+0000","last_peered":"2024-05-09T12:20:22.960799+0000","last_clean":"2024-05-09T12:20:22.960799+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:20:22.960799+0000","last_undegraded":"2024-05-09T12:20:22.960799+0000","last_fullsized":"2024-05-09T12:20:22.960799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:40.753966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631757+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:20:22.631757+0000","last_peered":"2024-05-09T12:20:22.631757+0000","last_clean":"2024-05-09T12:20:22.631757+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:20:22.631757+0000","last_undegraded":"2024-05-09T12:20:22.631757+0000","last_fullsized":"2024-05-09T12:20:22.631757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633261+0000","last_change":"2024-05-09T12:20:21.639712+0000","last_active":"2024-05-09T12:20:22.633261+0000","last_peered":"2024-05-09T12:20:22.633261+0000","last_clean":"2024-05-09T12:20:22.633261+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:20:22.633261+0000","last_undegraded":"2024-05-09T12:20:22.633261+0000","last_fullsized":"2024-05-09T12:20:22.633261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:55.515277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632264+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:20:22.632264+0000","last_peered":"2024-05-09T12:20:22.632264+0000","last_clean":"2024-05-09T12:20:22.632264+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:20:22.632264+0000","last_undegraded":"2024-05-09T12:20:22.632264+0000","last_fullsized":"2024-05-09T12:20:22.632264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633552+0000","last_change":"2024-05-09T12:20:21.643678+0000","last_active":"2024-05-09T12:20:22.633552+0000","last_peered":"2024-05-09T12:20:22.633552+0000","last_clean":"2024-05-09T12:20:22.633552+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:20:22.633552+0000","last_undegraded":"2024-05-09T12:20:22.633552+0000","last_fullsized":"2024-05-09T12:20:22.633552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:13.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632484+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:20:22.632484+0000","last_peered":"2024-05-09T12:20:22.632484+0000","last_clean":"2024-05-09T12:20:22.632484+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:20:22.632484+0000","last_undegraded":"2024-05-09T12:20:22.632484+0000","last_fullsized":"2024-05-09T12:20:22.632484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633609+0000","last_change":"2024-05-09T12:20:21.631510+0000","last_active":"2024-05-09T12:20:22.633609+0000","last_peered":"2024-05-09T12:20:22.633609+0000","last_clean":"2024-05-09T12:20:22.633609+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:20:22.633609+0000","last_undegraded":"2024-05-09T12:20:22.633609+0000","last_fullsized":"2024-05-09T12:20:22.633609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631208+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:20:22.631208+0000","last_peered":"2024-05-09T12:20:22.631208+0000","last_clean":"2024-05-09T12:20:22.631208+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:20:22.631208+0000","last_undegraded":"2024-05-09T12:20:22.631208+0000","last_fullsized":"2024-05-09T12:20:22.631208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631983+0000","last_change":"2024-05-09T12:20:21.632437+0000","last_active":"2024-05-09T12:20:22.631983+0000","last_peered":"2024-05-09T12:20:22.631983+0000","last_clean":"2024-05-09T12:20:22.631983+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:20:22.631983+0000","last_undegraded":"2024-05-09T12:20:22.631983+0000","last_fullsized":"2024-05-09T12:20:22.631983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633694+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:20:22.633694+0000","last_peered":"2024-05-09T12:20:22.633694+0000","last_clean":"2024-05-09T12:20:22.633694+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:20:22.633694+0000","last_undegraded":"2024-05-09T12:20:22.633694+0000","last_fullsized":"2024-05-09T12:20:22.633694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631554+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:20:22.631554+0000","last_peered":"2024-05-09T12:20:22.631554+0000","last_clean":"2024-05-09T12:20:22.631554+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:20:22.631554+0000","last_undegraded":"2024-05-09T12:20:22.631554+0000","last_fullsized":"2024-05-09T12:20:22.631554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633830+0000","last_change":"2024-05-09T12:20:21.643674+0000","last_active":"2024-05-09T12:20:22.633830+0000","last_peered":"2024-05-09T12:20:22.633830+0000","last_clean":"2024-05-09T12:20:22.633830+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:20:22.633830+0000","last_undegraded":"2024-05-09T12:20:22.633830+0000","last_fullsized":"2024-05-09T12:20:22.633830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:10.597391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632543+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:20:22.632543+0000","last_peered":"2024-05-09T12:20:22.632543+0000","last_clean":"2024-05-09T12:20:22.632543+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:20:22.632543+0000","last_undegraded":"2024-05-09T12:20:22.632543+0000","last_fullsized":"2024-05-09T12:20:22.632543+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633165+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:20:22.633165+0000","last_peered":"2024-05-09T12:20:22.633165+0000","last_clean":"2024-05-09T12:20:22.633165+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:20:22.633165+0000","last_undegraded":"2024-05-09T12:20:22.633165+0000","last_fullsized":"2024-05-09T12:20:22.633165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632062+0000","last_change":"2024-05-09T12:20:21.633583+0000","last_active":"2024-05-09T12:20:22.632062+0000","last_peered":"2024-05-09T12:20:22.632062+0000","last_clean":"2024-05-09T12:20:22.632062+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:20:22.632062+0000","last_undegraded":"2024-05-09T12:20:22.632062+0000","last_fullsized":"2024-05-09T12:20:22.632062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:44.424115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632628+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:20:22.632628+0000","last_peered":"2024-05-09T12:20:22.632628+0000","last_clean":"2024-05-09T12:20:22.632628+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:20:22.632628+0000","last_undegraded":"2024-05-09T12:20:22.632628+0000","last_fullsized":"2024-05-09T12:20:22.632628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631312+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:20:22.631312+0000","last_peered":"2024-05-09T12:20:22.631312+0000","last_clean":"2024-05-09T12:20:22.631312+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:20:22.631312+0000","last_undegraded":"2024-05-09T12:20:22.631312+0000","last_fullsized":"2024-05-09T12:20:22.631312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632143+0000","last_change":"2024-05-09T12:20:21.632822+0000","last_active":"2024-05-09T12:20:22.632143+0000","last_peered":"2024-05-09T12:20:22.632143+0000","last_clean":"2024-05-09T12:20:22.632143+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:20:22.632143+0000","last_undegraded":"2024-05-09T12:20:22.632143+0000","last_fullsized":"2024-05-09T12:20:22.632143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:19.909675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631884+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:20:22.631884+0000","last_peered":"2024-05-09T12:20:22.631884+0000","last_clean":"2024-05-09T12:20:22.631884+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:20:22.631884+0000","last_undegraded":"2024-05-09T12:20:22.631884+0000","last_fullsized":"2024-05-09T12:20:22.631884+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":110,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633858+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:20:22.633858+0000","last_peered":"2024-05-09T12:20:22.633858+0000","last_clean":"2024-05-09T12:20:22.633858+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:20:22.633858+0000","last_undegraded":"2024-05-09T12:20:22.633858+0000","last_fullsized":"2024-05-09T12:20:22.633858+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960462+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:20:22.960462+0000","last_peered":"2024-05-09T12:20:22.960462+0000","last_clean":"2024-05-09T12:20:22.960462+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:20:22.960462+0000","last_undegraded":"2024-05-09T12:20:22.960462+0000","last_fullsized":"2024-05-09T12:20:22.960462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960642+0000","last_change":"2024-05-09T12:20:21.634170+0000","last_active":"2024-05-09T12:20:22.960642+0000","last_peered":"2024-05-09T12:20:22.960642+0000","last_clean":"2024-05-09T12:20:22.960642+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:20:22.960642+0000","last_undegraded":"2024-05-09T12:20:22.960642+0000","last_fullsized":"2024-05-09T12:20:22.960642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:46.403294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:23.629858+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:20:23.629858+0000","last_peered":"2024-05-09T12:20:23.629858+0000","last_clean":"2024-05-09T12:20:23.629858+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:20:23.629858+0000","last_undegraded":"2024-05-09T12:20:23.629858+0000","last_fullsized":"2024-05-09T12:20:23.629858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632132+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:20:22.632132+0000","last_peered":"2024-05-09T12:20:22.632132+0000","last_clean":"2024-05-09T12:20:22.632132+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:20:22.632132+0000","last_undegraded":"2024-05-09T12:20:22.632132+0000","last_fullsized":"2024-05-09T12:20:22.632132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632858+0000","last_change":"2024-05-09T12:20:21.631044+0000","last_active":"2024-05-09T12:20:22.632858+0000","last_peered":"2024-05-09T12:20:22.632858+0000","last_clean":"2024-05-09T12:20:22.632858+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:20:22.632858+0000","last_undegraded":"2024-05-09T12:20:22.632858+0000","last_fullsized":"2024-05-09T12:20:22.632858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:22.128484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632267+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:20:22.632267+0000","last_peered":"2024-05-09T12:20:22.632267+0000","last_clean":"2024-05-09T12:20:22.632267+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:20:22.632267+0000","last_undegraded":"2024-05-09T12:20:22.632267+0000","last_fullsized":"2024-05-09T12:20:22.632267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633788+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:20:22.633788+0000","last_peered":"2024-05-09T12:20:22.633788+0000","last_clean":"2024-05-09T12:20:22.633788+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:20:22.633788+0000","last_undegraded":"2024-05-09T12:20:22.633788+0000","last_fullsized":"2024-05-09T12:20:22.633788+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960218+0000","last_change":"2024-05-09T12:20:21.636481+0000","last_active":"2024-05-09T12:20:22.960218+0000","last_peered":"2024-05-09T12:20:22.960218+0000","last_clean":"2024-05-09T12:20:22.960218+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:20:22.960218+0000","last_undegraded":"2024-05-09T12:20:22.960218+0000","last_fullsized":"2024-05-09T12:20:22.960218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632105+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:20:22.632105+0000","last_peered":"2024-05-09T12:20:22.632105+0000","last_clean":"2024-05-09T12:20:22.632105+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:20:22.632105+0000","last_undegraded":"2024-05-09T12:20:22.632105+0000","last_fullsized":"2024-05-09T12:20:22.632105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633121+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:20:22.633121+0000","last_peered":"2024-05-09T12:20:22.633121+0000","last_clean":"2024-05-09T12:20:22.633121+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:20:22.633121+0000","last_undegraded":"2024-05-09T12:20:22.633121+0000","last_fullsized":"2024-05-09T12:20:22.633121+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961013+0000","last_change":"2024-05-09T12:20:21.641170+0000","last_active":"2024-05-09T12:20:22.961013+0000","last_peered":"2024-05-09T12:20:22.961013+0000","last_clean":"2024-05-09T12:20:22.961013+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:20:22.961013+0000","last_undegraded":"2024-05-09T12:20:22.961013+0000","last_fullsized":"2024-05-09T12:20:22.961013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:19.343095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633653+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:20:22.633653+0000","last_peered":"2024-05-09T12:20:22.633653+0000","last_clean":"2024-05-09T12:20:22.633653+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:20:22.633653+0000","last_undegraded":"2024-05-09T12:20:22.633653+0000","last_fullsized":"2024-05-09T12:20:22.633653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633735+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:20:22.633735+0000","last_peered":"2024-05-09T12:20:22.633735+0000","last_clean":"2024-05-09T12:20:22.633735+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:20:22.633735+0000","last_undegraded":"2024-05-09T12:20:22.633735+0000","last_fullsized":"2024-05-09T12:20:22.633735+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631463+0000","last_change":"2024-05-09T12:20:21.630541+0000","last_active":"2024-05-09T12:20:22.631463+0000","last_peered":"2024-05-09T12:20:22.631463+0000","last_clean":"2024-05-09T12:20:22.631463+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:20:22.631463+0000","last_undegraded":"2024-05-09T12:20:22.631463+0000","last_fullsized":"2024-05-09T12:20:22.631463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:01.544273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633063+0000","last_change":"2024-05-09T12:20:21.630924+0000","last_active":"2024-05-09T12:20:22.633063+0000","last_peered":"2024-05-09T12:20:22.633063+0000","last_clean":"2024-05-09T12:20:22.633063+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:20:22.633063+0000","last_undegraded":"2024-05-09T12:20:22.633063+0000","last_fullsized":"2024-05-09T12:20:22.633063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633061+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:20:22.633061+0000","last_peered":"2024-05-09T12:20:22.633061+0000","last_clean":"2024-05-09T12:20:22.633061+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:20:22.633061+0000","last_undegraded":"2024-05-09T12:20:22.633061+0000","last_fullsized":"2024-05-09T12:20:22.633061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631908+0000","last_change":"2024-05-09T12:20:21.635202+0000","last_active":"2024-05-09T12:20:22.631908+0000","last_peered":"2024-05-09T12:20:22.631908+0000","last_clean":"2024-05-09T12:20:22.631908+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:20:22.631908+0000","last_undegraded":"2024-05-09T12:20:22.631908+0000","last_fullsized":"2024-05-09T12:20:22.631908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:44.116880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633873+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:20:22.633873+0000","last_peered":"2024-05-09T12:20:22.633873+0000","last_clean":"2024-05-09T12:20:22.633873+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:20:22.633873+0000","last_undegraded":"2024-05-09T12:20:22.633873+0000","last_fullsized":"2024-05-09T12:20:22.633873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633713+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:20:22.633713+0000","last_peered":"2024-05-09T12:20:22.633713+0000","last_clean":"2024-05-09T12:20:22.633713+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:20:22.633713+0000","last_undegraded":"2024-05-09T12:20:22.633713+0000","last_fullsized":"2024-05-09T12:20:22.633713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960371+0000","last_change":"2024-05-09T12:20:21.633256+0000","last_active":"2024-05-09T12:20:22.960371+0000","last_peered":"2024-05-09T12:20:22.960371+0000","last_clean":"2024-05-09T12:20:22.960371+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:20:22.960371+0000","last_undegraded":"2024-05-09T12:20:22.960371+0000","last_fullsized":"2024-05-09T12:20:22.960371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:12.688028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960984+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:20:22.960984+0000","last_peered":"2024-05-09T12:20:22.960984+0000","last_clean":"2024-05-09T12:20:22.960984+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:20:22.960984+0000","last_undegraded":"2024-05-09T12:20:22.960984+0000","last_fullsized":"2024-05-09T12:20:22.960984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631089+0000","last_change":"2024-05-09T12:20:21.635653+0000","last_active":"2024-05-09T12:20:22.631089+0000","last_peered":"2024-05-09T12:20:22.631089+0000","last_clean":"2024-05-09T12:20:22.631089+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:20:22.631089+0000","last_undegraded":"2024-05-09T12:20:22.631089+0000","last_fullsized":"2024-05-09T12:20:22.631089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:43.801109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633343+0000","last_change":"2024-05-09T12:20:21.644065+0000","last_active":"2024-05-09T12:20:22.633343+0000","last_peered":"2024-05-09T12:20:22.633343+0000","last_clean":"2024-05-09T12:20:22.633343+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:20:22.633343+0000","last_undegraded":"2024-05-09T12:20:22.633343+0000","last_fullsized":"2024-05-09T12:20:22.633343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:33.210315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631220+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:20:22.631220+0000","last_peered":"2024-05-09T12:20:22.631220+0000","last_clean":"2024-05-09T12:20:22.631220+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:20:22.631220+0000","last_undegraded":"2024-05-09T12:20:22.631220+0000","last_fullsized":"2024-05-09T12:20:22.631220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960567+0000","last_change":"2024-05-09T12:20:21.633601+0000","last_active":"2024-05-09T12:20:22.960567+0000","last_peered":"2024-05-09T12:20:22.960567+0000","last_clean":"2024-05-09T12:20:22.960567+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:20:22.960567+0000","last_undegraded":"2024-05-09T12:20:22.960567+0000","last_fullsized":"2024-05-09T12:20:22.960567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:22:43.472900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631280+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:20:22.631280+0000","last_peered":"2024-05-09T12:20:22.631280+0000","last_clean":"2024-05-09T12:20:22.631280+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:20:22.631280+0000","last_undegraded":"2024-05-09T12:20:22.631280+0000","last_fullsized":"2024-05-09T12:20:22.631280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960921+0000","last_change":"2024-05-09T12:20:21.638359+0000","last_active":"2024-05-09T12:20:22.960921+0000","last_peered":"2024-05-09T12:20:22.960921+0000","last_clean":"2024-05-09T12:20:22.960921+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:20:22.960921+0000","last_undegraded":"2024-05-09T12:20:22.960921+0000","last_fullsized":"2024-05-09T12:20:22.960921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:22.537436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632563+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:20:22.632563+0000","last_peered":"2024-05-09T12:20:22.632563+0000","last_clean":"2024-05-09T12:20:22.632563+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:20:22.632563+0000","last_undegraded":"2024-05-09T12:20:22.632563+0000","last_fullsized":"2024-05-09T12:20:22.632563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631862+0000","last_change":"2024-05-09T12:20:21.634182+0000","last_active":"2024-05-09T12:20:22.631862+0000","last_peered":"2024-05-09T12:20:22.631862+0000","last_clean":"2024-05-09T12:20:22.631862+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:20:22.631862+0000","last_undegraded":"2024-05-09T12:20:22.631862+0000","last_fullsized":"2024-05-09T12:20:22.631862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:26.149530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.961067+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:20:22.961067+0000","last_peered":"2024-05-09T12:20:22.961067+0000","last_clean":"2024-05-09T12:20:22.961067+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:20:22.961067+0000","last_undegraded":"2024-05-09T12:20:22.961067+0000","last_fullsized":"2024-05-09T12:20:22.961067+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633289+0000","last_change":"2024-05-09T12:20:21.638295+0000","last_active":"2024-05-09T12:20:22.633289+0000","last_peered":"2024-05-09T12:20:22.633289+0000","last_clean":"2024-05-09T12:20:22.633289+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:20:22.633289+0000","last_undegraded":"2024-05-09T12:20:22.633289+0000","last_fullsized":"2024-05-09T12:20:22.633289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:47.614527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632470+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:20:22.632470+0000","last_peered":"2024-05-09T12:20:22.632470+0000","last_clean":"2024-05-09T12:20:22.632470+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:20:22.632470+0000","last_undegraded":"2024-05-09T12:20:22.632470+0000","last_fullsized":"2024-05-09T12:20:22.632470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.632133+0000","last_change":"2024-05-09T12:20:21.642394+0000","last_active":"2024-05-09T12:20:22.632133+0000","last_peered":"2024-05-09T12:20:22.632133+0000","last_clean":"2024-05-09T12:20:22.632133+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:20:22.632133+0000","last_undegraded":"2024-05-09T12:20:22.632133+0000","last_fullsized":"2024-05-09T12:20:22.632133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.633690+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:20:22.633690+0000","last_peered":"2024-05-09T12:20:22.633690+0000","last_clean":"2024-05-09T12:20:22.633690+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:20:22.633690+0000","last_undegraded":"2024-05-09T12:20:22.633690+0000","last_fullsized":"2024-05-09T12:20:22.633690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960335+0000","last_change":"2024-05-09T12:20:21.634325+0000","last_active":"2024-05-09T12:20:22.960335+0000","last_peered":"2024-05-09T12:20:22.960335+0000","last_clean":"2024-05-09T12:20:22.960335+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:20:22.960335+0000","last_undegraded":"2024-05-09T12:20:22.960335+0000","last_fullsized":"2024-05-09T12:20:22.960335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:58.785302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960858+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:20:22.960858+0000","last_peered":"2024-05-09T12:20:22.960858+0000","last_clean":"2024-05-09T12:20:22.960858+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:20:22.960858+0000","last_undegraded":"2024-05-09T12:20:22.960858+0000","last_fullsized":"2024-05-09T12:20:22.960858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.631969+0000","last_change":"2024-05-09T12:20:21.638597+0000","last_active":"2024-05-09T12:20:22.631969+0000","last_peered":"2024-05-09T12:20:22.631969+0000","last_clean":"2024-05-09T12:20:22.631969+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:20:22.631969+0000","last_undegraded":"2024-05-09T12:20:22.631969+0000","last_fullsized":"2024-05-09T12:20:22.631969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:59:26.212511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T12:20:22.960843+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:20:22.960843+0000","last_peered":"2024-05-09T12:20:22.960843+0000","last_clean":"2024-05-09T12:20:22.960843+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:20:22.960843+0000","last_undegraded":"2024-05-09T12:20:22.960843+0000","last_fullsized":"2024-05-09T12:20:22.960843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":646638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":55708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":644318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":54692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:20:33.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T12:20:33.033 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T12:20:33.033 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T12:20:33.033 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T12:20:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.165+0000 7f52a63d7640 1 Processor -- start 2024-05-09T12:20:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.165+0000 7f52a63d7640 1 -- start start 2024-05-09T12:20:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.165+0000 7f52a63d7640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f52a01377d0 0x7f52a0137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a63d7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52a009b620 con 0x7f52a013ac80 2024-05-09T12:20:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a63d7640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52a0074350 con 0x7f52a009aa20 2024-05-09T12:20:33.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a63d7640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f52a009bf70 con 0x7f52a01377d0 2024-05-09T12:20:33.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a4974640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f52a013ac80 0x7f52a01428b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54132/0 (socket says 172.21.15.135:54132) 2024-05-09T12:20:33.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a4974640 1 -- 172.21.15.135:0/3844378384 learned_addr learned my addr 172.21.15.135:0/3844378384 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:33.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529ffff640 1 --2- 172.21.15.135:0/3844378384 >> v2:172.21.15.160:3300/0 conn(0x7f52a01377d0 0x7f52a0137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509174573 0 0) 0x7f52a009b620 con 0x7f52a013ac80 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f528c003520 con 0x7f52a013ac80 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 168142790 0 0) 0x7f528c003520 con 0x7f52a013ac80 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 >> v2:172.21.15.160:3300/0 conn(0x7f52a01377d0 msgr2=0x7f52a0137bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 --2- 172.21.15.135:0/3844378384 >> v2:172.21.15.160:3300/0 conn(0x7f52a01377d0 0x7f52a0137bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 >> v1:172.21.15.160:6789/0 conn(0x7f52a009aa20 legacy=0x7f52a013a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a009e7f0 con 0x7f52a013ac80 2024-05-09T12:20:33.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f5298001a70 con 0x7f52a013ac80 2024-05-09T12:20:33.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 >> v1:172.21.15.135:6789/0 conn(0x7f52a013ac80 legacy=0x7f52a01428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 0x7f528c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c004800 0x7f528c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f528c0052e0 0x7f528c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52a009bf70 con 0x7f528c003a50 2024-05-09T12:20:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f528c00c1b0 con 0x7f528c004800 2024-05-09T12:20:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f528c00c3b0 con 0x7f528c0052e0 2024-05-09T12:20:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f529ffff640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 0x7f528c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f5297fff640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c004800 0x7f528c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.166+0000 7f52a4974640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f528c0052e0 0x7f528c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 -- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f528c0052e0 msgr2=0x7f528c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f528c0052e0 0x7f528c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 -- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c004800 msgr2=0x7f528c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c004800 0x7f528c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 -- 172.21.15.135:0/3844378384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c003520 con 0x7f528c003a50 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f52a4974640 1 -- 172.21.15.135:0/3844378384 reap_dead start 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529ffff640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 0x7f528c003e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5290009ac0 tx=0x7f528c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fb911f7ffdca14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.167+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290039070 con 0x7f528c003a50 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529002c6b0 con 0x7f528c003a50 2024-05-09T12:20:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f529f7fe640 1 -- 172.21.15.135:0/3844378384 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290009690 con 0x7f528c003a50 2024-05-09T12:20:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 -- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 msgr2=0x7f528c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 0x7f528c003e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5290009ac0 tx=0x7f528c005830 comp rx=0 tx=0).stop 2024-05-09T12:20:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 -- 172.21.15.135:0/3844378384 shutdown_connections 2024-05-09T12:20:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 --2- 172.21.15.135:0/3844378384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f528c003a50 0x7f528c003e90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 -- 172.21.15.135:0/3844378384 >> 172.21.15.135:0/3844378384 conn(0x7f52a00ac9c0 msgr2=0x7f52a00acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 -- 172.21.15.135:0/3844378384 shutdown_connections 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.168+0000 7f52a63d7640 1 -- 172.21.15.135:0/3844378384 wait complete. 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.169+0000 7f52a63d7640 1 Processor -- start 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.169+0000 7f52a63d7640 1 -- start start 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c003a50 0x7f52a0136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52a0136ab0 0x7f52a01cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52a009cc80 con 0x7f52a01cff90 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f52a009b1d0 con 0x7f528c003a50 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f52a009ce00 con 0x7f52a0136ab0 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51448/0 (socket says 172.21.15.135:51448) 2024-05-09T12:20:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 -- 172.21.15.135:0/938662083 learned_addr learned my addr 172.21.15.135:0/938662083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f529ffff640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c003a50 0x7f52a0136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f5297fff640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52a0136ab0 0x7f52a01cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 -- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52a0136ab0 msgr2=0x7f52a01cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52a0136ab0 0x7f52a01cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 -- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c003a50 msgr2=0x7f52a0136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c003a50 0x7f52a0136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 -- 172.21.15.135:0/938662083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a00a4e00 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a4974640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52a0073e90 tx=0x7f5298007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529800ab10 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298018070 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980133f0 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a00a34b0 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.170+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a00a54c0 con 0x7f52a01cff90 2024-05-09T12:20:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.171+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a00508d0 con 0x7f52a01cff90 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.172+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5298013590 con 0x7f52a01cff90 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.172+0000 7f529d7fa640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 0x7f5280078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.172+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f5298097560 con 0x7f52a01cff90 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.172+0000 7f529ffff640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 0x7f5280078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.173+0000 7f529ffff640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 0x7f5280078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5290036000 tx=0x7f5290030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.176+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52a00a4e00 con 0x7f52a01cff90 2024-05-09T12:20:33.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.394+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f52a00a9a00 con 0x7f52a01cff90 2024-05-09T12:20:33.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.395+0000 7f529d7fa640 1 -- 172.21.15.135:0/938662083 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f52980614b0 con 0x7f52a01cff90 2024-05-09T12:20:33.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:33.395 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 msgr2=0x7f5280078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 0x7f5280078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5290036000 tx=0x7f5290030000 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 msgr2=0x7f52a01d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f52a0073e90 tx=0x7f5298007a90 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 shutdown_connections 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f52800762d0 0x7f5280078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52a01cff90 0x7f52a01d0410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52a0136ab0 0x7f52a01cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 --2- 172.21.15.135:0/938662083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f528c003a50 0x7f52a0136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 >> 172.21.15.135:0/938662083 conn(0x7f52a00ac9c0 msgr2=0x7f52a01c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 shutdown_connections 2024-05-09T12:20:33.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.397+0000 7f52a63d7640 1 -- 172.21.15.135:0/938662083 wait complete. 2024-05-09T12:20:33.408 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T12:20:33.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 Processor -- start 2024-05-09T12:20:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 -- start start 2024-05-09T12:20:33.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 0x7fac98139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac9813cd10 0x7fac98144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9806d870 con 0x7fac98139860 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac98073d50 con 0x7fac9813cd10 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7faca045e640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fac98072890 con 0x7fac98073440 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.509+0000 7fac9e9fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac9813cd10 0x7fac98144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac9813cd10 0x7fac98144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51458/0 (socket says 172.21.15.135:51458) 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 -- 172.21.15.135:0/271106375 learned_addr learned my addr 172.21.15.135:0/271106375 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e1fa640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fac98139860 0x7fac9813c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54138/0 (socket says 172.21.15.135:54138) 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9d9f9640 1 --2- 172.21.15.135:0/271106375 >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 0x7fac98139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 -- 172.21.15.135:0/271106375 >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 msgr2=0x7fac98139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 --2- 172.21.15.135:0/271106375 >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 0x7fac98139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 -- 172.21.15.135:0/271106375 >> v1:172.21.15.135:6789/0 conn(0x7fac98139860 legacy=0x7fac9813c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 -- 172.21.15.135:0/271106375 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac98073a90 con 0x7fac9813cd10 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9d9f9640 1 --2- 172.21.15.135:0/271106375 >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 0x7fac98139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:33.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.510+0000 7fac9e9fb640 1 --2- 172.21.15.135:0/271106375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9813cd10 0x7fac98144980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac9806f380 tx=0x7fac9002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e664dff237cab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7fac9d1f8640 1 -- 172.21.15.135:0/271106375 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9002c9f0 con 0x7fac9813cd10 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7fac9d1f8640 1 -- 172.21.15.135:0/271106375 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9002cb90 con 0x7fac9813cd10 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7fac9d1f8640 1 -- 172.21.15.135:0/271106375 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900343f0 con 0x7fac9813cd10 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 -- 172.21.15.135:0/271106375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9813cd10 msgr2=0x7fac98144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 --2- 172.21.15.135:0/271106375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9813cd10 0x7fac98144980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac9806f380 tx=0x7fac9002be50 comp rx=0 tx=0).stop 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 -- 172.21.15.135:0/271106375 shutdown_connections 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 --2- 172.21.15.135:0/271106375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac9813cd10 0x7fac98144980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 --2- 172.21.15.135:0/271106375 >> v2:172.21.15.160:3300/0 conn(0x7fac98073440 0x7fac98139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 -- 172.21.15.135:0/271106375 >> 172.21.15.135:0/271106375 conn(0x7fac980ac9c0 msgr2=0x7fac980acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 -- 172.21.15.135:0/271106375 shutdown_connections 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.511+0000 7faca045e640 1 -- 172.21.15.135:0/271106375 wait complete. 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.512+0000 7faca045e640 1 Processor -- start 2024-05-09T12:20:33.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.512+0000 7faca045e640 1 -- start start 2024-05-09T12:20:33.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac98073440 0x7fac981cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac9813cd10 0x7fac981d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac980747c0 con 0x7fac98139860 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac98072e60 con 0x7fac9813cd10 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fac98074940 con 0x7fac98073440 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51460/0 (socket says 172.21.15.135:51460) 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 -- 172.21.15.135:0/2786082089 learned_addr learned my addr 172.21.15.135:0/2786082089 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 -- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac98073440 msgr2=0x7fac981cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac98073440 0x7fac981cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9e9fb640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac9813cd10 0x7fac981d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 -- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac9813cd10 msgr2=0x7fac981d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac9813cd10 0x7fac981d1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 -- 172.21.15.135:0/2786082089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac980a3a50 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac9d9f9640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac8800c7f0 tx=0x7fac8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88015070 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac88007a30 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac981ce900 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88007e00 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.513+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac980a3c70 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.514+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac98073070 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.515+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac88018070 con 0x7fac98139860 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.515+0000 7fac8effd640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 0x7fac7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.515+0000 7fac9e1fa640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 0x7fac7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.515+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7fac88096f60 con 0x7fac98139860 2024-05-09T12:20:33.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.516+0000 7fac9e1fa640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 0x7fac7c078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac940015d0 tx=0x7fac940079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.520+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac98073070 con 0x7fac98139860 2024-05-09T12:20:33.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.740+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac980a4570 con 0x7fac98139860 2024-05-09T12:20:33.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.740+0000 7fac8effd640 1 -- 172.21.15.135:0/2786082089 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7fac88060eb0 con 0x7fac98139860 2024-05-09T12:20:33.740 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:33.741 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:20:33.741 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 msgr2=0x7fac7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 0x7fac7c078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac940015d0 tx=0x7fac940079c0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 msgr2=0x7fac981cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac8800c7f0 tx=0x7fac8800cbf0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 shutdown_connections 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fac7c0762d0 0x7fac7c078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac9813cd10 0x7fac981d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac98139860 0x7fac981cf390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 --2- 172.21.15.135:0/2786082089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac98073440 0x7fac981cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 >> 172.21.15.135:0/2786082089 conn(0x7fac980ac9c0 msgr2=0x7fac981c2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 shutdown_connections 2024-05-09T12:20:33.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.742+0000 7faca045e640 1 -- 172.21.15.135:0/2786082089 wait complete. 2024-05-09T12:20:33.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:33.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.854+0000 7f875651c640 1 Processor -- start 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.854+0000 7f875651c640 1 -- start start 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f875013c850 0x7f875013cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f875009b3d0 0x7f875013d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87501393c0 0x7f8750139850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f875009c2a0 con 0x7f875009b3d0 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f875013d6b0 con 0x7f875013c850 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f875651c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f875009cdf0 con 0x7f87501393c0 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f875009b3d0 0x7f875013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f875009b3d0 0x7f875013d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51474/0 (socket says 172.21.15.135:51474) 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 -- 172.21.15.135:0/3507887550 learned_addr learned my addr 172.21.15.135:0/3507887550 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874ffff640 1 --2- 172.21.15.135:0/3507887550 >> v2:172.21.15.160:3300/0 conn(0x7f875013c850 0x7f875013cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f8754ab9640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87501393c0 0x7f8750139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 -- 172.21.15.135:0/3507887550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87501393c0 msgr2=0x7f8750139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87501393c0 0x7f8750139850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 -- 172.21.15.135:0/3507887550 >> v2:172.21.15.160:3300/0 conn(0x7f875013c850 msgr2=0x7f875013cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:33.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 --2- 172.21.15.135:0/3507887550 >> v2:172.21.15.160:3300/0 conn(0x7f875013c850 0x7f875013cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.855+0000 7f874f7fe640 1 -- 172.21.15.135:0/3507887550 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500a09a0 con 0x7f875009b3d0 2024-05-09T12:20:33.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.856+0000 7f874f7fe640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f875009b3d0 0x7f875013d170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87500a0ba0 tx=0x7f873802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce57d11d1567ad87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.856+0000 7f874effd640 1 -- 172.21.15.135:0/3507887550 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87380317c0 con 0x7f875009b3d0 2024-05-09T12:20:33.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.856+0000 7f874effd640 1 -- 172.21.15.135:0/3507887550 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738037070 con 0x7f875009b3d0 2024-05-09T12:20:33.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.856+0000 7f874effd640 1 -- 172.21.15.135:0/3507887550 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738031b80 con 0x7f875009b3d0 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 -- 172.21.15.135:0/3507887550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f875009b3d0 msgr2=0x7f875013d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f875009b3d0 0x7f875013d170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87500a0ba0 tx=0x7f873802b860 comp rx=0 tx=0).stop 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 -- 172.21.15.135:0/3507887550 shutdown_connections 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87501393c0 0x7f8750139850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 --2- 172.21.15.135:0/3507887550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f875009b3d0 0x7f875013d170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 --2- 172.21.15.135:0/3507887550 >> v2:172.21.15.160:3300/0 conn(0x7f875013c850 0x7f875013cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 -- 172.21.15.135:0/3507887550 >> 172.21.15.135:0/3507887550 conn(0x7f8750075cf0 msgr2=0x7f87500aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 -- 172.21.15.135:0/3507887550 shutdown_connections 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.857+0000 7f875651c640 1 -- 172.21.15.135:0/3507887550 wait complete. 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 Processor -- start 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 -- start start 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f875009b3d0 0x7f87501d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f875013c850 0x7f87501d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f875009e670 con 0x7f87501393c0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f875009bc70 con 0x7f875009b3d0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.858+0000 7f875651c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f875009aa20 con 0x7f875013c850 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51488/0 (socket says 172.21.15.135:51488) 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 -- 172.21.15.135:0/1950052164 learned_addr learned my addr 172.21.15.135:0/1950052164 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f8754ab9640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f875013c850 0x7f87501d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874ffff640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f875009b3d0 0x7f87501d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 -- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f875013c850 msgr2=0x7f87501d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f875013c850 0x7f87501d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 -- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f875009b3d0 msgr2=0x7f87501d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f875009b3d0 0x7f87501d1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 -- 172.21.15.135:0/1950052164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500ab5e0 con 0x7f87501393c0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874f7fe640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f873802b8a0 tx=0x7f87380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738032650 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8738032810 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87500a9890 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8738032c00 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.859+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87500a95b0 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.860+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87500508d0 con 0x7f87501393c0 2024-05-09T12:20:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.861+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f873804c060 con 0x7f87501393c0 2024-05-09T12:20:33.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.861+0000 7f874cff9640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 0x7f8730078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:33.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.861+0000 7f874ffff640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 0x7f8730078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:33.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.861+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f87380b8950 con 0x7f87501393c0 2024-05-09T12:20:33.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.862+0000 7f874ffff640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 0x7f8730078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8740006fd0 tx=0x7f8740008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:33.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:33.866+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8738040070 con 0x7f87501393c0 2024-05-09T12:20:34.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.082+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8750138ba0 con 0x7f87501393c0 2024-05-09T12:20:34.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.082+0000 7f874cff9640 1 -- 172.21.15.135:0/1950052164 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f8738034e40 con 0x7f87501393c0 2024-05-09T12:20:34.082 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:34.082 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:20:34.083 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:20:34.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 msgr2=0x7f8730078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 0x7f8730078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8740006fd0 tx=0x7f8740008040 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 msgr2=0x7f87501d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f873802b8a0 tx=0x7f87380046c0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 shutdown_connections 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f87300762d0 0x7f8730078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f875013c850 0x7f87501d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87501393c0 0x7f87501d2070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 --2- 172.21.15.135:0/1950052164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f875009b3d0 0x7f87501d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 >> 172.21.15.135:0/1950052164 conn(0x7f8750075cf0 msgr2=0x7f87500a23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 shutdown_connections 2024-05-09T12:20:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.084+0000 7f875651c640 1 -- 172.21.15.135:0/1950052164 wait complete. 2024-05-09T12:20:34.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:20:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 Processor -- start 2024-05-09T12:20:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 -- start start 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f32f40a6d80 0x7f32f4139e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f40abd70 con 0x7f32f4139a80 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f40a88d0 con 0x7f32f40a9df0 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32fc03c640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f32f40a8610 con 0x7f32f40a6d80 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32f9dd8640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f32f4139a80 0x7f32f40a96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54140/0 (socket says 172.21.15.135:54140) 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.195+0000 7f32f9dd8640 1 -- 172.21.15.135:0/1434733739 learned_addr learned my addr 172.21.15.135:0/1434733739 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f95d7640 1 --2- 172.21.15.135:0/1434733739 >> v2:172.21.15.160:3300/0 conn(0x7f32f40a6d80 0x7f32f4139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617154493 0 0) 0x7f32f0001110 con 0x7f32f4139a80 2024-05-09T12:20:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32e0003520 con 0x7f32f4139a80 2024-05-09T12:20:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f95d7640 1 -- 172.21.15.135:0/1434733739 >> v1:172.21.15.160:6789/0 conn(0x7f32f40a9df0 legacy=0x7f32f4144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2623346073 0 0) 0x7f32e0003520 con 0x7f32f4139a80 2024-05-09T12:20:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f95d7640 1 -- 172.21.15.135:0/1434733739 >> v1:172.21.15.135:6789/0 conn(0x7f32f4139a80 legacy=0x7f32f40a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.196+0000 7f32f95d7640 1 -- 172.21.15.135:0/1434733739 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40a6250 con 0x7f32f40a6d80 2024-05-09T12:20:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32f95d7640 1 --2- 172.21.15.135:0/1434733739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f40a6d80 0x7f32f4139e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f76259eed6771bfa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037070 con 0x7f32f40a6d80 2024-05-09T12:20:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4030510 con 0x7f32f40a6d80 2024-05-09T12:20:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32f8dd6640 1 -- 172.21.15.135:0/1434733739 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f00018c0 con 0x7f32f40a6d80 2024-05-09T12:20:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 -- 172.21.15.135:0/1434733739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f40a6d80 msgr2=0x7f32f4139e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 --2- 172.21.15.135:0/1434733739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f40a6d80 0x7f32f4139e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b710 comp rx=0 tx=0).stop 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 -- 172.21.15.135:0/1434733739 shutdown_connections 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 --2- 172.21.15.135:0/1434733739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f40a6d80 0x7f32f4139e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 -- 172.21.15.135:0/1434733739 >> 172.21.15.135:0/1434733739 conn(0x7f32f40756c0 msgr2=0x7f32f4075ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 -- 172.21.15.135:0/1434733739 shutdown_connections 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.197+0000 7f32fc03c640 1 -- 172.21.15.135:0/1434733739 wait complete. 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.198+0000 7f32fc03c640 1 Processor -- start 2024-05-09T12:20:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.198+0000 7f32fc03c640 1 -- start start 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32f40a9df0 0x7f32f41cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 0x7f32f41d2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40abff0 con 0x7f32f40a6d80 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40aa9e0 con 0x7f32f4139a80 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32f40a7650 con 0x7f32f40a9df0 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51502/0 (socket says 172.21.15.135:51502) 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 -- 172.21.15.135:0/3982215817 learned_addr learned my addr 172.21.15.135:0/3982215817 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fa5d9640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 0x7f32f41d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f95d7640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32f40a9df0 0x7f32f41cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 -- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32f40a9df0 msgr2=0x7f32f41cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32f40a9df0 0x7f32f41cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 -- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 msgr2=0x7f32f41d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 0x7f32f41d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 -- 172.21.15.135:0/3982215817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40a01a0 con 0x7f32f40a6d80 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fa5d9640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 0x7f32f41d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32f9dd8640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001a30 tx=0x7f32f000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0005ad0 con 0x7f32f40a6d80 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f0005c90 con 0x7f32f40a6d80 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.199+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f40a0780 con 0x7f32f40a6d80 2024-05-09T12:20:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.200+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f00072b0 con 0x7f32f40a6d80 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.200+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f40a1130 con 0x7f32f40a6d80 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.201+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f40add50 con 0x7f32f40a6d80 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.201+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32f0007450 con 0x7f32f40a6d80 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.202+0000 7f32ea7fc640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 0x7f32d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.202+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f32f0096db0 con 0x7f32f40a6d80 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.202+0000 7f32f95d7640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 0x7f32d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.202+0000 7f32f95d7640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 0x7f32d8078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32e4034000 tx=0x7f32e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.206+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32f40abd70 con 0x7f32f40a6d80 2024-05-09T12:20:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.388+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32f40af020 con 0x7f32f40a6d80 2024-05-09T12:20:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.389+0000 7f32ea7fc640 1 -- 172.21.15.135:0/3982215817 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+13581 (secure 0 0 0) 0x7f32f0060d00 con 0x7f32f40a6d80 2024-05-09T12:20:34.389 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:34.389 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:20:22.622854+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 msgr2=0x7f32d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 0x7f32d8078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32e4034000 tx=0x7f32e4008030 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 msgr2=0x7f32f41cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001a30 tx=0x7f32f000cbb0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 shutdown_connections 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f32d80762d0 0x7f32d8078790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32f4139a80 0x7f32f41d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32f40a9df0 0x7f32f41cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 --2- 172.21.15.135:0/3982215817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32f40a6d80 0x7f32f41cf090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 >> 172.21.15.135:0/3982215817 conn(0x7f32f40756c0 msgr2=0x7f32f41c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:34.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 shutdown_connections 2024-05-09T12:20:34.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.392+0000 7f32fc03c640 1 -- 172.21.15.135:0/3982215817 wait complete. 2024-05-09T12:20:34.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:20:34.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.507+0000 7f81674eb640 1 Processor -- start 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 -- start start 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160138c30 0x7f816009c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8160142a10 0x7f8160144e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f816009ddb0 con 0x7f8160138850 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f816009dae0 con 0x7f8160142a10 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f81674eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f816009f6e0 con 0x7f8160138c30 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8160142a10 0x7f8160144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8160142a10 0x7f8160144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51510/0 (socket says 172.21.15.135:51510) 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165287640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8160138850 0x7f816009ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54150/0 (socket says 172.21.15.135:54150) 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 -- 172.21.15.135:0/855581511 learned_addr learned my addr 172.21.15.135:0/855581511 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8164a86640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160138c30 0x7f816009c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 -- 172.21.15.135:0/855581511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160138c30 msgr2=0x7f816009c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:34.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160138c30 0x7f816009c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8165a88640 1 -- 172.21.15.135:0/855581511 >> v1:172.21.15.135:6789/0 conn(0x7f8160138850 legacy=0x7f816009ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.508+0000 7f8153fff640 1 -- 172.21.15.135:0/855581511 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544958215 0 0) 0x7f816009ddb0 con 0x7f8160138850 2024-05-09T12:20:34.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.509+0000 7f8165a88640 1 -- 172.21.15.135:0/855581511 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816006ce60 con 0x7f8160142a10 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.509+0000 7f8165a88640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160142a10 0x7f8160144e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8158009e50 tx=0x7f815802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc90e141e52955d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.509+0000 7f8153fff640 1 -- 172.21.15.135:0/855581511 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815802c9e0 con 0x7f8160142a10 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.509+0000 7f8153fff640 1 -- 172.21.15.135:0/855581511 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815802cb80 con 0x7f8160142a10 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.509+0000 7f8153fff640 1 -- 172.21.15.135:0/855581511 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580343f0 con 0x7f8160142a10 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 -- 172.21.15.135:0/855581511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160142a10 msgr2=0x7f8160144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160142a10 0x7f8160144e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8158009e50 tx=0x7f815802be40 comp rx=0 tx=0).stop 2024-05-09T12:20:34.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 -- 172.21.15.135:0/855581511 shutdown_connections 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160138c30 0x7f816009c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 --2- 172.21.15.135:0/855581511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160142a10 0x7f8160144e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 -- 172.21.15.135:0/855581511 >> 172.21.15.135:0/855581511 conn(0x7f81600ab9b0 msgr2=0x7f81600abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 -- 172.21.15.135:0/855581511 shutdown_connections 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.510+0000 7f81674eb640 1 -- 172.21.15.135:0/855581511 wait complete. 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 Processor -- start 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 -- start start 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8160138c30 0x7f8160135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160142a10 0x7f81601d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81600a02c0 con 0x7f8160138850 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f81600a8c90 con 0x7f8160138c30 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.511+0000 7f81674eb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f816009cd80 con 0x7f8160142a10 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51526/0 (socket says 172.21.15.135:51526) 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 -- 172.21.15.135:0/1609831985 learned_addr learned my addr 172.21.15.135:0/1609831985 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:34.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 -- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160142a10 msgr2=0x7f81601d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160142a10 0x7f81601d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 -- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8160138c30 msgr2=0x7f8160135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8160138c30 0x7f8160135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 -- 172.21.15.135:0/1609831985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816013a950 con 0x7f8160138850 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8165287640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f815400c3e0 tx=0x7f815400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540074e0 con 0x7f8160138850 2024-05-09T12:20:34.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81540047e0 con 0x7f8160138850 2024-05-09T12:20:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154004bd0 con 0x7f8160138850 2024-05-09T12:20:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81600a6d60 con 0x7f8160138850 2024-05-09T12:20:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.512+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816013c110 con 0x7f8160138850 2024-05-09T12:20:34.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.513+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816009eaf0 con 0x7f8160138850 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.514+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8154011070 con 0x7f8160138850 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.514+0000 7f8151ffb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 0x7f8144078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.515+0000 7f8164a86640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 0x7f8144078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.515+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f8154096c30 con 0x7f8160138850 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.515+0000 7f8164a86640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 0x7f8144078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f815c006a90 tx=0x7f815c006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:34.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.519+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f816009eaf0 con 0x7f8160138850 2024-05-09T12:20:34.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.742+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816006a6d0 con 0x7f8160138850 2024-05-09T12:20:34.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.742+0000 7f8151ffb640 1 -- 172.21.15.135:0/1609831985 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7f816006a6d0 con 0x7f8160138850 2024-05-09T12:20:34.743 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:20:34.743 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:20:34.743 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:20:34.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 msgr2=0x7f8144078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 0x7f8144078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f815c006a90 tx=0x7f815c006a20 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 msgr2=0x7f81601355f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f815400c3e0 tx=0x7f815400c8a0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 shutdown_connections 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f81440762d0 0x7f8144078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8160142a10 0x7f81601d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8160138c30 0x7f8160135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 --2- 172.21.15.135:0/1609831985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8160138850 0x7f81601355f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 >> 172.21.15.135:0/1609831985 conn(0x7f81600ab9b0 msgr2=0x7f81600aa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 shutdown_connections 2024-05-09T12:20:34.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:34.745+0000 7f81674eb640 1 -- 172.21.15.135:0/1609831985 wait complete. 2024-05-09T12:20:34.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T12:20:20.983047+0000', 'modified': '2024-05-09T12:20:22.975757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4215': {'gid': 4215, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.135:6819/2919634794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6818', 'nonce': 2919634794}, {'type': 'v1', 'addr': '172.21.15.135:6819', 'nonce': 2919634794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4215, 'qdb_cluster': [4215]} 2024-05-09T12:20:34.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T12:20:34.958 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T12:20:35.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.060+0000 7ff89e283640 1 Processor -- start 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.060+0000 7ff89e283640 1 -- start start 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89e283640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff89813ac70 0x7ff89813b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89e283640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff89809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89e283640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89809c860 con 0x7ff89809c3f0 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89e283640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7ff898072db0 con 0x7ff89813ac70 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89e283640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff898070370 con 0x7ff89809ba30 2024-05-09T12:20:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89c820640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff89809c3f0 0x7ff8981418a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54164/0 (socket says 172.21.15.135:54164) 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89c820640 1 -- 172.21.15.135:0/1868716456 learned_addr learned my addr 172.21.15.135:0/1868716456 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779506576 0 0) 0x7ff890001490 con 0x7ff89809c3f0 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff880003520 con 0x7ff89809c3f0 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff897fff640 1 --2- 172.21.15.135:0/1868716456 >> v2:172.21.15.160:3300/0 conn(0x7ff89813ac70 0x7ff89813b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff8977fe640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff89809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2618428909 0 0) 0x7ff880003520 con 0x7ff89809c3f0 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 msgr2=0x7ff89809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff89809beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 >> v2:172.21.15.160:3300/0 conn(0x7ff89813ac70 msgr2=0x7ff89813b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 --2- 172.21.15.135:0/1868716456 >> v2:172.21.15.160:3300/0 conn(0x7ff89813ac70 0x7ff89813b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff898073be0 con 0x7ff89809c3f0 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7ff890001c40 con 0x7ff89809c3f0 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 >> v1:172.21.15.135:6789/0 conn(0x7ff89809c3f0 legacy=0x7ff8981418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff880003a50 0x7ff880003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff880004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff8800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff898072db0 con 0x7ff880004d40 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff898070370 con 0x7ff880003a50 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff88000bb70 con 0x7ff89809ba30 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff89c820640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff8800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff897fff640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff880003a50 0x7ff880003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.061+0000 7ff8977fe640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff880004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 -- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 msgr2=0x7ff880004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff89809ba30 0x7ff880004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 -- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff880003a50 msgr2=0x7ff880003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff880003a50 0x7ff880003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 -- 172.21.15.135:0/1868716456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff880003520 con 0x7ff880004d40 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.062+0000 7ff89c820640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff8800051c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff89000a9d0 tx=0x7ff880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d01f2d901df2a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89000a5f0 con 0x7ff880004d40 2024-05-09T12:20:35.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff890034650 con 0x7ff880004d40 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff896ffd640 1 -- 172.21.15.135:0/1868716456 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890034a40 con 0x7ff880004d40 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 -- 172.21.15.135:0/1868716456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 msgr2=0x7ff8800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 --2- 172.21.15.135:0/1868716456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff8800051c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff89000a9d0 tx=0x7ff880005830 comp rx=0 tx=0).stop 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89c820640 1 -- 172.21.15.135:0/1868716456 reap_dead start 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 -- 172.21.15.135:0/1868716456 shutdown_connections 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 -- 172.21.15.135:0/1868716456 >> 172.21.15.135:0/1868716456 conn(0x7ff8980aa930 msgr2=0x7ff8980aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 -- 172.21.15.135:0/1868716456 shutdown_connections 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.063+0000 7ff89e283640 1 -- 172.21.15.135:0/1868716456 wait complete. 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.064+0000 7ff89e283640 1 Processor -- start 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.064+0000 7ff89e283640 1 -- start start 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8980a47b0 0x7ff898137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8981cfe30 0x7ff8981d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8980735e0 con 0x7ff880004d40 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff898073ec0 con 0x7ff8981cfe30 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff898072970 con 0x7ff8980a47b0 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51544/0 (socket says 172.21.15.135:51544) 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 -- 172.21.15.135:0/2729424696 learned_addr learned my addr 172.21.15.135:0/2729424696 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89c820640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8981cfe30 0x7ff8981d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff8977fe640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8980a47b0 0x7ff898137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 -- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8980a47b0 msgr2=0x7ff898137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8980a47b0 0x7ff898137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 -- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8981cfe30 msgr2=0x7ff8981d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8981cfe30 0x7ff8981d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 -- 172.21.15.135:0/2729424696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8980a52b0 con 0x7ff880004d40 2024-05-09T12:20:35.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff897fff640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff888011aa0 tx=0x7ff888011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff894ff9640 1 -- 172.21.15.135:0/2729424696 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88800fb80 con 0x7ff880004d40 2024-05-09T12:20:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff894ff9640 1 -- 172.21.15.135:0/2729424696 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88800fd20 con 0x7ff880004d40 2024-05-09T12:20:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8980a5740 con 0x7ff880004d40 2024-05-09T12:20:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff894ff9640 1 -- 172.21.15.135:0/2729424696 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888014660 con 0x7ff880004d40 2024-05-09T12:20:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.065+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8980a6ae0 con 0x7ff880004d40 2024-05-09T12:20:35.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.067+0000 7ff894ff9640 1 -- 172.21.15.135:0/2729424696 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff888012040 con 0x7ff880004d40 2024-05-09T12:20:35.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.068+0000 7ff894ff9640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 0x7ff884078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.068+0000 7ff8977fe640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 0x7ff884078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.068+0000 7ff894ff9640 1 -- 172.21.15.135:0/2729424696 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7ff888097750 con 0x7ff880004d40 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.068+0000 7ff8977fe640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 0x7ff884078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8981d0ef0 tx=0x7ff88c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.068+0000 7ff8a0e75740 1 Processor -- start 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 -- start start 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a796a0 0x560225a5c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a5cb70 0x560225a764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602259c66a0 con 0x560225a60bf0 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5602259624b0 con 0x560225a796a0 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5602259c2660 con 0x560225a5cb70 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51546/0 (socket says 172.21.15.135:51546) 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 -- 172.21.15.135:0/2845562302 learned_addr learned my addr 172.21.15.135:0/2845562302 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff8977fe640 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a796a0 0x560225a5c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff89c820640 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a5cb70 0x560225a764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 -- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a5cb70 msgr2=0x560225a764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a5cb70 0x560225a764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 -- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a796a0 msgr2=0x560225a5c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a796a0 0x560225a5c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 -- 172.21.15.135:0/2845562302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56022598beb0 con 0x560225a60bf0 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.069+0000 7ff897fff640 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff888096210 tx=0x7ff888060e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42235f63380c100 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff87dffb640 1 -- 172.21.15.135:0/2845562302 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888022050 con 0x560225a60bf0 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff87dffb640 1 -- 172.21.15.135:0/2845562302 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff888061620 con 0x560225a60bf0 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff87dffb640 1 -- 172.21.15.135:0/2845562302 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8880613c0 con 0x560225a60bf0 2024-05-09T12:20:35.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 -- 172.21.15.135:0/2845562302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 msgr2=0x560225a5c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff888096210 tx=0x7ff888060e20 comp rx=0 tx=0).stop 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 -- 172.21.15.135:0/2845562302 shutdown_connections 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a5cb70 0x560225a764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a796a0 0x560225a5c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/2845562302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a60bf0 0x560225a5c0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 -- 172.21.15.135:0/2845562302 >> 172.21.15.135:0/2845562302 conn(0x560225a5de50 msgr2=0x560225a5edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 -- 172.21.15.135:0/2845562302 shutdown_connections 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.070+0000 7ff8a0e75740 1 -- 172.21.15.135:0/2845562302 wait complete. 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 -- start start 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 Processor -- start 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a60bf0 0x560225a91b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a7e690 0x560225a94b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560225a5d650 con 0x560225a796a0 2024-05-09T12:20:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56022594d430 con 0x560225a7e690 2024-05-09T12:20:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x560225a79df0 con 0x560225a60bf0 2024-05-09T12:20:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8a0e75740 10 client.0 _ll_register_callbacks cb 0x56022596fcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T12:20:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.071+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51552/0 (socket says 172.21.15.135:51552) 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 -- 172.21.15.135:0/3639277433 learned_addr learned my addr 172.21.15.135:0/3639277433 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff89c820640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a7e690 0x560225a94b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff897fff640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a60bf0 0x560225a91b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 -- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a60bf0 msgr2=0x560225a91b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a60bf0 0x560225a91b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 -- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a7e690 msgr2=0x560225a94b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a7e690 0x560225a94b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 -- 172.21.15.135:0/3639277433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602256d82d0 con 0x560225a796a0 2024-05-09T12:20:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8977fe640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff88c016a40 tx=0x7ff88c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2fbcab9359f2e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c015b50 con 0x560225a796a0 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7ff88c015cf0 con 0x560225a796a0 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff888061620 con 0x560225a796a0 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7ff88c024430 con 0x560225a796a0 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8a0e75740 10 client.4509 fetch_fsmap learned FSMap version 6 2024-05-09T12:20:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5602257a26b0 con 0x560225a796a0 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff888061620 con 0x560225a796a0 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.072+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7ff88c02c400 con 0x560225a796a0 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 10 client.4509 fetch_fsmap finished waiting for FSMap version 6 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 10 client.4509 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 20 client.4509 populate_metadata read hostname 'smithi135' 2024-05-09T12:20:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225a9e530 0x560225aa0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 4 client.4509 mds_command: new command op to 4215 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 --> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602259d42b0 con 0x560225a9e530 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff897fff640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225a9e530 0x560225aa0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff876ffd640 10 client.4509 ms_handle_connect on v2:172.21.15.135:6818/2919634794 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.073+0000 7ff897fff640 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225a9e530 0x560225aa0920 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=975cc6083a29fec3 server_cookie=1d4e4e270aa0ebfc in_seq=0 out_seq=0 2024-05-09T12:20:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff876ffd640 1 -- 172.21.15.135:0/3639277433 <== mds.0 v2:172.21.15.135:6818/2919634794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5602259d42b0 con 0x560225a9e530 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff876ffd640 10 client.4509 handle_command_reply: tid=0 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 client.4509 shutdown 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 msgr2=0x560225a920b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff88c016a40 tx=0x7ff88c004730 comp rx=0 tx=0).stop 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 shutdown_connections 2024-05-09T12:20:35.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225a9e530 0x560225aa0920 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a7e690 0x560225a94b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225a920b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff876ffd640 0 client.4509 ms_handle_reset on v2:172.21.15.135:6818/2919634794 2024-05-09T12:20:35.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/3639277433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a60bf0 0x560225a91b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 >> 172.21.15.135:0/3639277433 conn(0x560225a5cb70 msgr2=0x560225a84ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 shutdown_connections 2024-05-09T12:20:35.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 1 -- 172.21.15.135:0/3639277433 wait complete. 2024-05-09T12:20:35.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.074+0000 7ff8a0e75740 20 client.4509 trim_cache size 0 max 16384 2024-05-09T12:20:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.092+0000 7ff8a0e75740 1 Processor -- start 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.092+0000 7ff8a0e75740 1 -- start start 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225aa4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a7e690 0x560225aa5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8981da3b0 con 0x560225a796a0 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff8981d94a0 con 0x560225a60bf0 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x560225a95590 con 0x560225a7e690 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51568/0 (socket says 172.21.15.135:51568) 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 -- 172.21.15.135:0/15934132 learned_addr learned my addr 172.21.15.135:0/15934132 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 -- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a7e690 msgr2=0x560225aa5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a7e690 0x560225aa5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 -- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 msgr2=0x560225aa4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225aa4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 -- 172.21.15.135:0/15934132 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560225a77710 con 0x560225a796a0 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff8977fe640 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff88c02de30 tx=0x7ff88c025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3a5a0262edade8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.093+0000 7ff87d7fa640 1 -- 172.21.15.135:0/15934132 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c041070 con 0x560225a796a0 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff87d7fa640 1 -- 172.21.15.135:0/15934132 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c02c400 con 0x560225a796a0 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff87d7fa640 1 -- 172.21.15.135:0/15934132 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c015b50 con 0x560225a796a0 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 -- 172.21.15.135:0/15934132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 msgr2=0x560225aa5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff88c02de30 tx=0x7ff88c025000 comp rx=0 tx=0).stop 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 -- 172.21.15.135:0/15934132 shutdown_connections 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a7e690 0x560225aa5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a796a0 0x560225aa5510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/15934132 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225aa4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 -- 172.21.15.135:0/15934132 >> 172.21.15.135:0/15934132 conn(0x560225a5cb70 msgr2=0x560225a5ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 -- 172.21.15.135:0/15934132 shutdown_connections 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.094+0000 7ff8a0e75740 1 -- 172.21.15.135:0/15934132 wait complete. 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 -- start start 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 Processor -- start 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225afc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a796a0 0x560225afce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560225a7e1e0 con 0x560225a7e690 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x560225a959e0 con 0x560225a60bf0 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x560225a95710 con 0x560225a796a0 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8a0e75740 10 client.0 _ll_register_callbacks cb 0x7ff88c01a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff89c820640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff89c820640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51570/0 (socket says 172.21.15.135:51570) 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a796a0 0x560225afce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff89c820640 1 -- 172.21.15.135:0/307756505 learned_addr learned my addr 172.21.15.135:0/307756505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.095+0000 7ff897fff640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225afc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 -- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a796a0 msgr2=0x560225afce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a796a0 0x560225afce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 -- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 msgr2=0x560225afc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225afc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 -- 172.21.15.135:0/307756505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560225adfdb0 con 0x560225a7e690 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff89c820640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff89000aaf0 tx=0x7ff8980a8450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfeef0ca804cf1df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890039040 con 0x560225a7e690 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7ff890001400 con 0x560225a7e690 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff88c02c400 con 0x560225a7e690 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7ff89004d050 con 0x560225a7e690 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 10 client.4515 fetch_fsmap learned FSMap version 6 2024-05-09T12:20:35.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x560225a9a930 con 0x560225a7e690 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c02c400 con 0x560225a7e690 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7ff890050020 con 0x560225a7e690 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 10 client.4515 fetch_fsmap finished waiting for FSMap version 6 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 10 client.4515 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 20 client.4515 populate_metadata read hostname 'smithi135' 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225b0a2e0 0x560225b0c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 4 client.4515 mds_command: new command op to 4215 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 --> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] -- command(tid 0: {"prefix": "status"}) -- 0x5602259ce120 con 0x560225b0a2e0 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.096+0000 7ff897fff640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225b0a2e0 0x560225b0c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff876ffd640 10 client.4515 ms_handle_connect on v2:172.21.15.135:6818/2919634794 2024-05-09T12:20:35.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff897fff640 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225b0a2e0 0x560225b0c6d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=568d57bfd8c3fce1 server_cookie=b844119a98b1f05c in_seq=0 out_seq=0 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff876ffd640 1 -- 172.21.15.135:0/307756505 <== mds.0 v2:172.21.15.135:6818/2919634794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x5602259ce120 con 0x560225b0a2e0 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff876ffd640 10 client.4515 handle_command_reply: tid=0 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 client.4515 shutdown 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 msgr2=0x560225aff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff89000aaf0 tx=0x7ff8980a8450 comp rx=0 tx=0).stop 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 shutdown_connections 2024-05-09T12:20:35.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:6818/2919634794,v1:172.21.15.135:6819/2919634794] conn(0x560225b0a2e0 0x560225b0c6d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560225a7e690 0x560225aff9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff876ffd640 0 client.4515 ms_handle_reset on v2:172.21.15.135:6818/2919634794 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x560225a796a0 0x560225afce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 --2- 172.21.15.135:0/307756505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560225a60bf0 0x560225afc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 >> 172.21.15.135:0/307756505 conn(0x560225a5cb70 msgr2=0x560225a8e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 shutdown_connections 2024-05-09T12:20:35.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 1 -- 172.21.15.135:0/307756505 wait complete. 2024-05-09T12:20:35.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.097+0000 7ff8a0e75740 20 client.4515 trim_cache size 0 max 16384 2024-05-09T12:20:35.116 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-09T12:20:35.116 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "c87e53f9-e7b2-4007-9931-7931693416e8", 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4215, 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 13.47517929, 2024-05-09T12:20:35.117 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 6, 2024-05-09T12:20:35.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 17, 2024-05-09T12:20:35.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 17, 2024-05-09T12:20:35.118 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 19.420914652 2024-05-09T12:20:35.118 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 msgr2=0x7ff884078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 0x7ff884078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8981d0ef0 tx=0x7ff88c008040 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 msgr2=0x7ff898137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff888011aa0 tx=0x7ff888011f60 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 shutdown_connections 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff8840762d0 0x7ff884078790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8981cfe30 0x7ff8981d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8980a47b0 0x7ff898137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 --2- 172.21.15.135:0/2729424696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff880004d40 0x7ff898137430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 >> 172.21.15.135:0/2729424696 conn(0x7ff8980aa930 msgr2=0x7ff8981c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 shutdown_connections 2024-05-09T12:20:35.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.098+0000 7ff89e283640 1 -- 172.21.15.135:0/2729424696 wait complete. 2024-05-09T12:20:35.121 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-09T12:20:35.157 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-09T12:20:35.157 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-09T12:20:35.158 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-09T12:20:35.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T12:20:35.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:35.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:35.158 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-05-09T12:20:35.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:35.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-05-09T12:20:35.251 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2024-05-09T12:20:35.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:20:35.252 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-09T12:20:35.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 Processor -- start 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 -- start start 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75c8136620 0x7f75c8136a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c806f1c0 con 0x7f75c813c880 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c80a0480 con 0x7f75c813d410 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75cdeff640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f75c8136f40 con 0x7f75c8136620 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75c77fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75c8136620 0x7f75c8136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75c6ffd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f75c813c880 0x7f75c813cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:54178/0 (socket says 172.21.15.135:54178) 2024-05-09T12:20:35.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75c77fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75c8136620 0x7f75c8136a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51574/0 (socket says 172.21.15.135:51574) 2024-05-09T12:20:35.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75c6ffd640 1 -- 172.21.15.135:0/918209894 learned_addr learned my addr 172.21.15.135:0/918209894 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:20:35.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.353+0000 7f75c77fe640 1 -- 172.21.15.135:0/918209894 >> v1:172.21.15.160:6789/0 conn(0x7f75c813d410 legacy=0x7f75c8144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c77fe640 1 -- 172.21.15.135:0/918209894 >> v1:172.21.15.135:6789/0 conn(0x7f75c813c880 legacy=0x7f75c813cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c67fc640 1 -- 172.21.15.135:0/918209894 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601307232 0 0) 0x7f75c806f1c0 con 0x7f75c813c880 2024-05-09T12:20:35.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c77fe640 1 -- 172.21.15.135:0/918209894 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c8073610 con 0x7f75c8136620 2024-05-09T12:20:35.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c77fe640 1 --2- 172.21.15.135:0/918209894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8136a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009de0 tx=0x7f75c002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbad7c0746ba85b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c67fc640 1 -- 172.21.15.135:0/918209894 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0039070 con 0x7f75c8136620 2024-05-09T12:20:35.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c67fc640 1 -- 172.21.15.135:0/918209894 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c002ccb0 con 0x7f75c8136620 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.354+0000 7f75c67fc640 1 -- 172.21.15.135:0/918209894 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c002ce60 con 0x7f75c8136620 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 -- 172.21.15.135:0/918209894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 msgr2=0x7f75c8136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 --2- 172.21.15.135:0/918209894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8136a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009de0 tx=0x7f75c002bf00 comp rx=0 tx=0).stop 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 -- 172.21.15.135:0/918209894 shutdown_connections 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 --2- 172.21.15.135:0/918209894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8136a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 -- 172.21.15.135:0/918209894 >> 172.21.15.135:0/918209894 conn(0x7f75c80acb30 msgr2=0x7f75c80acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 -- 172.21.15.135:0/918209894 shutdown_connections 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.355+0000 7f75cdeff640 1 -- 172.21.15.135:0/918209894 wait complete. 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 Processor -- start 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 -- start start 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 0x7f75c8133ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c813d410 0x7f75c81d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8073c80 con 0x7f75c8136620 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f75c80730a0 con 0x7f75c813c880 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.356+0000 7f75cdeff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f75c8073f40 con 0x7f75c813d410 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51584/0 (socket says 172.21.15.135:51584) 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 -- 172.21.15.135:0/2716363607 learned_addr learned my addr 172.21.15.135:0/2716363607 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c6ffd640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 0x7f75c8133ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c7fff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c813d410 0x7f75c81d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 -- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c813d410 msgr2=0x7f75c81d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c813d410 0x7f75c81d1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 -- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 msgr2=0x7f75c8133ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 0x7f75c8133ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 -- 172.21.15.135:0/2716363607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c80a94b0 con 0x7f75c8136620 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c6ffd640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 0x7f75c8133ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:20:35.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75c77fe640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75c0037040 tx=0x7f75c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0039050 con 0x7f75c8136620 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0045070 con 0x7f75c8136620 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c813bd70 con 0x7f75c8136620 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c002ce60 con 0x7f75c8136620 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.357+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c80a1570 con 0x7f75c8136620 2024-05-09T12:20:35.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.358+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c80a98a0 con 0x7f75c8136620 2024-05-09T12:20:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.359+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75c002cb70 con 0x7f75c8136620 2024-05-09T12:20:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.359+0000 7f75bffff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 0x7f75a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:20:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.359+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4334+0+0 (secure 0 0 0) 0x7f75c00b9c60 con 0x7f75c8136620 2024-05-09T12:20:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.359+0000 7f75c6ffd640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 0x7f75a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:20:35.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.360+0000 7f75c6ffd640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 0x7f75a8078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007fd0 tx=0x7f75b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:20:35.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.364+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75c0083bb0 con 0x7f75c8136620 2024-05-09T12:20:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.583+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75c80508d0 con 0x7f75c8136620 2024-05-09T12:20:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.583+0000 7f75bffff640 1 -- 172.21.15.135:0/2716363607 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f75c00834b0 con 0x7f75c8136620 2024-05-09T12:20:35.583 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 msgr2=0x7f75a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 0x7f75a8078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f75b0007fd0 tx=0x7f75b0009040 comp rx=0 tx=0).stop 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 msgr2=0x7f75c8133580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75c0037040 tx=0x7f75c0004a40 comp rx=0 tx=0).stop 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 shutdown_connections 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f75a80762d0 0x7f75a8078790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c813d410 0x7f75c81d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c813c880 0x7f75c8133ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 --2- 172.21.15.135:0/2716363607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75c8136620 0x7f75c8133580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:20:35.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 >> 172.21.15.135:0/2716363607 conn(0x7f75c80acb30 msgr2=0x7f75c806d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:20:35.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 shutdown_connections 2024-05-09T12:20:35.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:20:35.585+0000 7f75cdeff640 1 -- 172.21.15.135:0/2716363607 wait complete. 2024-05-09T12:20:35.595 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T12:20:35.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T12:20:35.595 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2024-05-09T12:20:35.595 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T12:20:35.595 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:35.596 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T12:20:35.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T12:20:35.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T12:20:35.596 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T12:20:35.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:35.596 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2024-05-09T12:20:35.613 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-05-09T12:20:35.614 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T12:20:35.615 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-05-09T12:20:35.616 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2024-05-09T12:20:35.616 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-05-09T12:20:35.616 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T12:20:35.616 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T12:20:35.616 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-05-09T12:20:35.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add name ceph-brx type bridge 2024-05-09T12:20:35.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr flush dev ceph-brx 2024-05-09T12:20:35.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set ceph-brx up 2024-05-09T12:20:35.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T12:20:35.617 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-05-09T12:20:35.704 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T12:20:35.796 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:35.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:35.803 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T12:20:35.826 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-05-09T12:20:35.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:35.828 DEBUG:teuthology.orchestra.run.smithi188:> route 2024-05-09T12:20:35.918 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2024-05-09T12:20:35.918 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T12:20:35.918 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T12:20:35.918 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T12:20:35.918 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T12:20:35.919 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-05-09T12:20:35.969 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T12:20:36.205 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:36.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:36.211 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-05-09T12:20:36.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:36.227 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2024-05-09T12:20:36.283 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T12:20:36.283 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-05-09T12:20:36.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:20:36.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T12:20:36.283 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-05-09T12:20:36.372 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T12:20:36.394 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:36.401 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-05-09T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T12:20:36.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T12:20:36.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T12:20:36.402 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-05-09T12:20:36.449 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T12:20:36.519 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:36.548 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T12:20:36.548 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-05-09T12:20:36.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2024-05-09T12:20:36.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T12:20:36.548 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-05-09T12:20:36.598 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T12:20:36.619 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:36.628 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-09T12:20:36.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T12:20:36.628 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:36.643 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T12:20:36.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T12:20:36.643 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:36.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2024-05-09T12:20:36.766 DEBUG:teuthology.orchestra.run.smithi188:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T12:20:36.822 INFO:teuthology.orchestra.run.smithi188.stdout:/proc 2024-05-09T12:20:36.822 INFO:teuthology.orchestra.run.smithi188.stdout:/sys 2024-05-09T12:20:36.822 INFO:teuthology.orchestra.run.smithi188.stdout:/dev 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/security 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/shm 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/pts 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/run 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/cgroup 2024-05-09T12:20:36.823 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/pstore 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/bpf 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/ 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/selinux 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/hugepages 2024-05-09T12:20:36.824 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/mqueue 2024-05-09T12:20:36.825 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/debug 2024-05-09T12:20:36.825 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/tracing 2024-05-09T12:20:36.825 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/fuse/connections 2024-05-09T12:20:36.825 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/config 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/run/user/1000 2024-05-09T12:20:36.826 INFO:teuthology.orchestra.run.smithi188.stdout:/var/lib/ceph 2024-05-09T12:20:36.827 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns 2024-05-09T12:20:36.827 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:20:36.827 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:20:36.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:36.827 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2024-05-09T12:20:36.878 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T12:20:36.878 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-09T12:20:36.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo modprobe fuse 2024-05-09T12:20:36.948 DEBUG:teuthology.orchestra.run.smithi188:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T12:20:37.004 INFO:teuthology.orchestra.run.smithi188.stdout:/proc 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/sys 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/dev 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/security 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/shm 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/pts 2024-05-09T12:20:37.005 INFO:teuthology.orchestra.run.smithi188.stdout:/run 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/cgroup 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/pstore 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/bpf 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/ 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/selinux 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T12:20:37.006 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/hugepages 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/dev/mqueue 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/debug 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/tracing 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/fs/fuse/connections 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/sys/kernel/config 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/user/1000 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/var/lib/ceph 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns 2024-05-09T12:20:37.007 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:20:37.008 INFO:teuthology.orchestra.run.smithi188.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:20:37.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:37.008 DEBUG:teuthology.orchestra.run.smithi188:> ls /sys/fs/fuse/connections 2024-05-09T12:20:37.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi188.stderr:2024-05-09T12:20:37.019+0000 7f838dc3e480 -1 init, newargv = 0x557a212bfbe0 newargc=15 2024-05-09T12:20:37.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi188.stderr:ceph-fuse[27218]: starting ceph client 2024-05-09T12:20:37.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi188.stderr:ceph-fuse[27218]: starting fuse 2024-05-09T12:20:37.034 INFO:teuthology.orchestra.run.smithi188.stdout:40 2024-05-09T12:20:37.035 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo stdin-killer -- python3 -c ' 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> import glob 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> import re 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> import os 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> import subprocess 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> def _find_admin_socket(client_name): 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> files = glob.glob(asok_path) 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-09T12:20:37.035 DEBUG:teuthology.orchestra.run.smithi188:> 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> # Given a non-glob path, it better be there 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> if "*" not in asok_path: 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> assert(len(files) == 1) 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> return files[0] 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> for f in files: 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> contents = proc_f.read() 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> if mountpoint in contents: 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> return f 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> 2024-05-09T12:20:37.036 DEBUG:teuthology.orchestra.run.smithi188:> print(_find_admin_socket("client.0")) 2024-05-09T12:20:37.037 DEBUG:teuthology.orchestra.run.smithi188:> ' 2024-05-09T12:20:37.152 INFO:teuthology.orchestra.run.smithi188.stdout:/var/run/ceph/ceph-client.0.27218.asok 2024-05-09T12:20:37.155 INFO:teuthology.orchestra.run.smithi188.stderr:2024-05-09T12:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T12:20:37.163 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.27218.asok 2024-05-09T12:20:37.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:37.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.27218.asok status 2024-05-09T12:20:37.296 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "metadata": { 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_sha1": "720f8e954cd9c4d6163a1fee379f1c286b4f5c7e", 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 19.0.0-3575-g720f8e95 (720f8e954cd9c4d6163a1fee379f1c286b4f5c7e) squid (dev)", 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "entity_id": "0", 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "hostname": "smithi188", 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-09T12:20:37.297 INFO:teuthology.orchestra.run.smithi188.stdout: "pid": "27218", 2024-05-09T12:20:37.298 INFO:teuthology.orchestra.run.smithi188.stdout: "root": "/" 2024-05-09T12:20:37.298 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-05-09T12:20:37.298 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_count": 0, 2024-05-09T12:20:37.298 INFO:teuthology.orchestra.run.smithi188.stdout: "dentry_pinned_count": 0, 2024-05-09T12:20:37.298 INFO:teuthology.orchestra.run.smithi188.stdout: "id": 4530, 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: "inst": { 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: "name": { 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "client", 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: "num": 4530 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-05-09T12:20:37.299 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "172.21.15.188:0", 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 756650157 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: } 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": { 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "type": "v1", 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "addr": "172.21.15.188:0", 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "nonce": 756650157 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: }, 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "inst_str": "client.4530 172.21.15.188:0/756650157", 2024-05-09T12:20:37.300 INFO:teuthology.orchestra.run.smithi188.stdout: "addr_str": "172.21.15.188:0/756650157", 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "inode_count": 1, 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "mds_epoch": 6, 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch": 17, 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "osd_epoch_barrier": 0, 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "blocklisted": false, 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout: "fs_name": "cephfs" 2024-05-09T12:20:37.301 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-05-09T12:20:37.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:37.305 DEBUG:teuthology.orchestra.run.smithi188:> stat --file-system '--printf=%T 2024-05-09T12:20:37.305 DEBUG:teuthology.orchestra.run.smithi188:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.321 INFO:teuthology.orchestra.run.smithi188.stdout:fuseblk 2024-05-09T12:20:37.322 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:20:37.322 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.387 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T12:20:37.399 INFO:tasks.workunit:Pulling workunits from ref e789e13b84d622c44a76f34b06dedf79bf4b7d36 2024-05-09T12:20:37.400 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T12:20:37.400 DEBUG:teuthology.orchestra.run.smithi188:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-05-09 12:20:21.624060386 +0000 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-05-09 12:20:37.387464534 +0000 2024-05-09T12:20:37.444 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: - 2024-05-09T12:20:37.445 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T12:20:37.445 DEBUG:teuthology.orchestra.run.smithi188:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T12:20:37.516 INFO:tasks.workunit:timeout=3h 2024-05-09T12:20:37.516 INFO:tasks.workunit:cleanup=True 2024-05-09T12:20:37.517 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e789e13b84d622c44a76f34b06dedf79bf4b7d36 2024-05-09T12:20:37.573 INFO:tasks.workunit.client.0.smithi188.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T12:20:45.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:20:45.538 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:20:45.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:15.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:15.863 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:15.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:45.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:45.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:46.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:21:49.521 INFO:tasks.workunit.client.0.smithi188.stderr:Note: switching to 'e789e13b84d622c44a76f34b06dedf79bf4b7d36'. 2024-05-09T12:21:49.521 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.521 INFO:tasks.workunit.client.0.smithi188.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T12:21:49.521 INFO:tasks.workunit.client.0.smithi188.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T12:21:49.521 INFO:tasks.workunit.client.0.smithi188.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: git switch -c 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr:Or undo this operation with: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: git switch - 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr: 2024-05-09T12:21:49.522 INFO:tasks.workunit.client.0.smithi188.stderr:HEAD is now at e789e13b84d Merge pull request #56865 from zmc/cmake-sccache-max-jobs 2024-05-09T12:21:49.524 DEBUG:teuthology.orchestra.run.smithi188:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T12:21:49.644 INFO:tasks.workunit.client.0.smithi188.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T12:21:49.646 INFO:tasks.workunit.client.0.smithi188.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T12:21:49.646 INFO:tasks.workunit.client.0.smithi188.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T12:21:50.382 INFO:tasks.workunit.client.0.smithi188.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T12:21:50.452 INFO:tasks.workunit.client.0.smithi188.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T12:21:50.494 INFO:tasks.workunit.client.0.smithi188.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T12:21:50.498 INFO:tasks.workunit.client.0.smithi188.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T12:21:50.498 INFO:tasks.workunit.client.0.smithi188.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T12:21:50.533 INFO:tasks.workunit.client.0.smithi188.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T12:21:50.537 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:21:50.537 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T12:21:50.552 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2024-05-09T12:21:50.554 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2024-05-09T12:21:50.554 DEBUG:teuthology.orchestra.run.smithi188:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e789e13b84d622c44a76f34b06dedf79bf4b7d36 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2024-05-09T12:21:50.655 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 126 tests from 4 test suites. 2024-05-09T12:21:50.656 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:21:50.656 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 117 tests from LibCephFS 2024-05-09T12:21:50.656 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2024-05-09T12:21:50.680 INFO:tasks.workunit.client.0.smithi188.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@default"} 2024-05-09T12:21:50.706 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (51 ms) 2024-05-09T12:21:50.706 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2024-05-09T12:21:50.734 INFO:tasks.workunit.client.0.smithi188.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@set"} 2024-05-09T12:21:50.735 INFO:tasks.workunit.client.0.smithi188.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@inherited"} 2024-05-09T12:21:50.758 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (52 ms) 2024-05-09T12:21:50.758 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2024-05-09T12:21:50.811 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (53 ms) 2024-05-09T12:21:50.811 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2024-05-09T12:21:50.858 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (47 ms) 2024-05-09T12:21:50.858 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2024-05-09T12:21:50.906 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (48 ms) 2024-05-09T12:21:50.910 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2024-05-09T12:21:50.945 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (39 ms) 2024-05-09T12:21:50.946 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2024-05-09T12:21:50.980 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetAndSetDirPin (35 ms) 2024-05-09T12:21:50.981 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2024-05-09T12:21:51.016 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (36 ms) 2024-05-09T12:21:51.016 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2024-05-09T12:21:51.051 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (35 ms) 2024-05-09T12:21:51.051 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DelegMultiClient 2024-05-09T12:21:52.328 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DelegMultiClient (1276 ms) 2024-05-09T12:21:52.328 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DelegSingleClient 2024-05-09T12:21:52.467 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DelegSingleClient (140 ms) 2024-05-09T12:21:52.467 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DelegTimeout 2024-05-09T12:21:57.539 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DelegTimeout (5071 ms) 2024-05-09T12:21:57.539 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.RecalledGetattr 2024-05-09T12:21:57.617 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.RecalledGetattr (79 ms) 2024-05-09T12:21:57.617 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2024-05-09T12:21:57.651 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.BasicRecordLocking (34 ms) 2024-05-09T12:21:57.652 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2024-05-09T12:21:57.703 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (52 ms) 2024-05-09T12:21:57.703 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2024-05-09T12:21:57.769 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (66 ms) 2024-05-09T12:21:57.769 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.BasicLocking 2024-05-09T12:21:57.799 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.BasicLocking (30 ms) 2024-05-09T12:21:57.799 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2024-05-09T12:21:57.848 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ConcurrentLocking (49 ms) 2024-05-09T12:21:57.848 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2024-05-09T12:21:57.912 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ThreesomeLocking (64 ms) 2024-05-09T12:21:57.912 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MulticlientSimple 2024-05-09T12:21:58.008 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MulticlientSimple (95 ms) 2024-05-09T12:21:58.008 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2024-05-09T12:21:58.057 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (49 ms) 2024-05-09T12:21:58.057 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2024-05-09T12:22:16.148 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:16.150 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:16.153 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:46.372 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:46.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:46.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:22:58.094 INFO:tasks.workunit.client.0.smithi188.stdout: Will run test for 60 seconds! 2024-05-09T12:22:58.094 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60036 ms) 2024-05-09T12:22:58.094 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReaddirRCB 2024-05-09T12:22:58.125 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReaddirRCB (32 ms) 2024-05-09T12:22:58.125 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2024-05-09T12:22:58.213 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OpenEmptyComponent (88 ms) 2024-05-09T12:22:58.213 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2024-05-09T12:23:00.688 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OpenReadTruncate (2474 ms) 2024-05-09T12:23:00.688 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OpenReadWrite 2024-05-09T12:23:00.717 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OpenReadWrite (29 ms) 2024-05-09T12:23:00.717 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MountNonExist 2024-05-09T12:23:00.736 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MountNonExist (19 ms) 2024-05-09T12:23:00.736 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MountDouble 2024-05-09T12:23:00.755 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MountDouble (19 ms) 2024-05-09T12:23:00.755 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MountRemount 2024-05-09T12:23:00.781 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MountRemount (26 ms) 2024-05-09T12:23:00.781 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2024-05-09T12:23:00.789 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.UnmountUnmounted (9 ms) 2024-05-09T12:23:00.790 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2024-05-09T12:23:00.798 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2024-05-09T12:23:00.798 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReleaseMounted 2024-05-09T12:23:00.815 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReleaseMounted (17 ms) 2024-05-09T12:23:00.815 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.UnmountRelease 2024-05-09T12:23:00.833 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.UnmountRelease (17 ms) 2024-05-09T12:23:00.833 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Mount 2024-05-09T12:23:01.867 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Mount (1034 ms) 2024-05-09T12:23:01.867 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OpenLayout 2024-05-09T12:23:01.911 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OpenLayout (45 ms) 2024-05-09T12:23:01.912 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DirLs 2024-05-09T12:23:10.864 INFO:tasks.workunit.client.0.smithi188.stdout:rand: 2266 2024-05-09T12:23:10.864 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DirLs (8952 ms) 2024-05-09T12:23:10.864 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2024-05-09T12:23:11.197 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ManyNestedDirs (333 ms) 2024-05-09T12:23:11.197 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Xattrs 2024-05-09T12:23:11.244 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_a 2024-05-09T12:23:11.244 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_b 2024-05-09T12:23:11.244 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_c 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_d 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_e 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_f 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_g 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_h 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_i 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_j 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_k 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_l 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_m 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_n 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_o 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_p 2024-05-09T12:23:11.245 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_q 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_r 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_s 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_t 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_u 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_v 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_w 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_x 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_y 2024-05-09T12:23:11.246 INFO:tasks.workunit.client.0.smithi188.stdout:getting attr user.test_xattr_z 2024-05-09T12:23:11.275 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Xattrs (78 ms) 2024-05-09T12:23:11.275 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Xattrs_ll 2024-05-09T12:23:11.295 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Xattrs_ll (20 ms) 2024-05-09T12:23:11.295 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LstatSlashdot 2024-05-09T12:23:11.311 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LstatSlashdot (17 ms) 2024-05-09T12:23:11.311 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.StatDirNlink 2024-05-09T12:23:11.354 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.StatDirNlink (42 ms) 2024-05-09T12:23:11.354 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DoubleChmod 2024-05-09T12:23:11.378 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DoubleChmod (25 ms) 2024-05-09T12:23:11.378 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Fchmod 2024-05-09T12:23:11.401 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Fchmod (22 ms) 2024-05-09T12:23:11.401 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Lchmod 2024-05-09T12:23:11.428 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Lchmod (27 ms) 2024-05-09T12:23:11.428 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Fchown 2024-05-09T12:23:11.448 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Fchown (21 ms) 2024-05-09T12:23:11.448 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.FlagO_PATH 2024-05-09T12:23:11.467 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.FlagO_PATH (19 ms) 2024-05-09T12:23:11.467 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Symlinks 2024-05-09T12:23:11.499 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Symlinks (31 ms) 2024-05-09T12:23:11.499 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DirSyms 2024-05-09T12:23:11.548 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DirSyms (49 ms) 2024-05-09T12:23:11.548 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LoopSyms 2024-05-09T12:23:11.596 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LoopSyms (48 ms) 2024-05-09T12:23:11.596 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2024-05-09T12:23:11.678 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (82 ms) 2024-05-09T12:23:11.678 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.BadArgument 2024-05-09T12:23:11.703 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.BadArgument (25 ms) 2024-05-09T12:23:11.703 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.BadFileDesc 2024-05-09T12:23:11.770 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.BadFileDesc (67 ms) 2024-05-09T12:23:11.770 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2024-05-09T12:23:11.967 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReadEmptyFile (196 ms) 2024-05-09T12:23:11.967 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.PreadvPwritev 2024-05-09T12:23:12.008 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.PreadvPwritev (41 ms) 2024-05-09T12:23:12.008 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2024-05-09T12:23:12.053 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LlreadvLlwritev (45 ms) 2024-05-09T12:23:12.053 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.StripeUnitGran 2024-05-09T12:23:12.077 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.StripeUnitGran (24 ms) 2024-05-09T12:23:12.077 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Rename 2024-05-09T12:23:12.118 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Rename (41 ms) 2024-05-09T12:23:12.118 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.UseUnmounted 2024-05-09T12:23:12.126 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.UseUnmounted (8 ms) 2024-05-09T12:23:12.126 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetPoolId 2024-05-09T12:23:12.142 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetPoolId (17 ms) 2024-05-09T12:23:12.142 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetPoolReplication 2024-05-09T12:23:12.159 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetPoolReplication (16 ms) 2024-05-09T12:23:12.159 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetExtentOsds 2024-05-09T12:23:12.178 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetExtentOsds (19 ms) 2024-05-09T12:23:12.178 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2024-05-09T12:23:12.197 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (20 ms) 2024-05-09T12:23:12.197 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.GetOsdAddr 2024-05-09T12:23:12.214 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.GetOsdAddr (16 ms) 2024-05-09T12:23:12.214 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OpenNoClose 2024-05-09T12:23:12.247 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OpenNoClose (33 ms) 2024-05-09T12:23:12.247 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Nlink 2024-05-09T12:23:12.295 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Nlink (48 ms) 2024-05-09T12:23:12.295 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SlashDotDot 2024-05-09T12:23:13.348 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SlashDotDot (1053 ms) 2024-05-09T12:23:13.348 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Btime 2024-05-09T12:23:14.376 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Btime (1029 ms) 2024-05-09T12:23:14.377 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SetBtime 2024-05-09T12:23:14.403 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SetBtime (26 ms) 2024-05-09T12:23:14.403 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LazyStatx 2024-05-09T12:23:15.453 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LazyStatx (1050 ms) 2024-05-09T12:23:15.453 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ChangeAttr 2024-05-09T12:23:15.486 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ChangeAttr (34 ms) 2024-05-09T12:23:15.486 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2024-05-09T12:23:15.532 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (45 ms) 2024-05-09T12:23:15.532 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2024-05-09T12:23:15.594 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (62 ms) 2024-05-09T12:23:15.594 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2024-05-09T12:23:15.653 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (60 ms) 2024-05-09T12:23:15.653 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SetSize 2024-05-09T12:23:15.693 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SetSize (40 ms) 2024-05-09T12:23:15.694 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2024-05-09T12:23:15.713 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OperationsOnRoot (20 ms) 2024-05-09T12:23:15.713 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ShutdownRace 2024-05-09T12:23:15.713 INFO:tasks.workunit.client.0.smithi188.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2024-05-09T12:23:16.450 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:16.453 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:16.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:43.025 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ShutdownRace (27311 ms) 2024-05-09T12:23:43.025 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.TestUtime 2024-05-09T12:23:43.052 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.TestUtime (28 ms) 2024-05-09T12:23:43.053 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.TestUtimes 2024-05-09T12:23:43.086 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.TestUtimes (34 ms) 2024-05-09T12:23:43.087 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.TestFutimens 2024-05-09T12:23:43.113 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.TestFutimens (26 ms) 2024-05-09T12:23:43.113 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2024-05-09T12:23:43.144 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.OperationsOnDotDot (32 ms) 2024-05-09T12:23:43.145 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Caps_vxattr 2024-05-09T12:23:43.166 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Caps_vxattr (22 ms) 2024-05-09T12:23:43.166 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapXattrs 2024-05-09T12:23:44.183 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapXattrs (1016 ms) 2024-05-09T12:23:44.184 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Lseek 2024-05-09T12:23:44.214 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Lseek (31 ms) 2024-05-09T12:23:44.214 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2024-05-09T12:23:44.235 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (21 ms) 2024-05-09T12:23:44.235 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2024-05-09T12:23:45.254 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.EmptySnapInfo (1019 ms) 2024-05-09T12:23:45.254 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapInfo 2024-05-09T12:23:46.273 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapInfo (1019 ms) 2024-05-09T12:23:46.273 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2024-05-09T12:23:46.294 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LookupInoMDSDir (21 ms) 2024-05-09T12:23:46.294 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LookupVino 2024-05-09T12:23:46.540 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:46.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:46.546 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:23:48.350 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LookupVino (2056 ms) 2024-05-09T12:23:48.350 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Openat 2024-05-09T12:23:48.394 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Openat (45 ms) 2024-05-09T12:23:48.395 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Statxat 2024-05-09T12:23:48.471 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Statxat (77 ms) 2024-05-09T12:23:48.472 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2024-05-09T12:23:48.532 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.StatxatATFDCWD (61 ms) 2024-05-09T12:23:48.533 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Fdopendir 2024-05-09T12:23:48.595 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Fdopendir (62 ms) 2024-05-09T12:23:48.595 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2024-05-09T12:23:48.666 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (71 ms) 2024-05-09T12:23:48.666 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2024-05-09T12:23:48.724 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (58 ms) 2024-05-09T12:23:48.724 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2024-05-09T12:23:48.783 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (59 ms) 2024-05-09T12:23:48.783 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Mkdirat 2024-05-09T12:23:48.839 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Mkdirat (56 ms) 2024-05-09T12:23:48.839 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2024-05-09T12:23:48.870 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (31 ms) 2024-05-09T12:23:48.870 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Readlinkat 2024-05-09T12:23:48.909 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Readlinkat (39 ms) 2024-05-09T12:23:48.909 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2024-05-09T12:23:48.973 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (65 ms) 2024-05-09T12:23:48.974 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Symlinkat 2024-05-09T12:23:49.034 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Symlinkat (60 ms) 2024-05-09T12:23:49.034 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2024-05-09T12:23:49.098 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (65 ms) 2024-05-09T12:23:49.099 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Unlinkat 2024-05-09T12:23:49.167 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Unlinkat (68 ms) 2024-05-09T12:23:49.168 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2024-05-09T12:23:49.231 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (64 ms) 2024-05-09T12:23:49.231 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Chownat 2024-05-09T12:23:49.297 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Chownat (66 ms) 2024-05-09T12:23:49.297 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2024-05-09T12:23:49.353 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ChownatATFDCWD (56 ms) 2024-05-09T12:23:49.353 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Chmodat 2024-05-09T12:23:49.414 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Chmodat (61 ms) 2024-05-09T12:23:49.414 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2024-05-09T12:23:49.488 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (74 ms) 2024-05-09T12:23:49.488 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.Utimensat 2024-05-09T12:23:50.699 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.Utimensat (1211 ms) 2024-05-09T12:23:50.699 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2024-05-09T12:23:55.701 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5002 ms) 2024-05-09T12:23:55.701 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2024-05-09T12:23:55.975 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (274 ms) 2024-05-09T12:23:55.976 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2024-05-09T12:23:55.993 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (19 ms) 2024-05-09T12:23:55.993 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SetMountTimeout 2024-05-09T12:23:56.010 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SetMountTimeout (17 ms) 2024-05-09T12:23:56.010 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.FsCrypt 2024-05-09T12:23:57.040 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.FsCrypt (1029 ms) 2024-05-09T12:23:57.040 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2024-05-09T12:23:58.060 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapdirAttrs (1020 ms) 2024-05-09T12:23:58.060 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2024-05-09T12:23:59.080 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1020 ms) 2024-05-09T12:23:59.080 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2024-05-09T12:24:00.099 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1019 ms) 2024-05-09T12:24:00.099 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2024-05-09T12:24:01.118 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1019 ms) 2024-05-09T12:24:01.119 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 117 tests from LibCephFS (130462 ms total) 2024-05-09T12:24:01.119 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:01.119 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 3 tests from MonConfig 2024-05-09T12:24:01.119 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] MonConfig.MonAddrsMissing 2024-05-09T12:24:01.128 INFO:tasks.workunit.client.0.smithi188.stderr:failed to get an address for mon.a: error -2 2024-05-09T12:24:01.128 INFO:tasks.workunit.client.0.smithi188.stderr:failed to get an address for mon.b: error -2 2024-05-09T12:24:01.128 INFO:tasks.workunit.client.0.smithi188.stderr:failed to get an address for mon.c: error -2 2024-05-09T12:24:01.163 INFO:tasks.workunit.client.0.smithi188.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-05-09T12:24:01.163 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] MonConfig.MonAddrsMissing (45 ms) 2024-05-09T12:24:01.163 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2024-05-09T12:24:02.183 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (1020 ms) 2024-05-09T12:24:02.183 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] MonConfig.MonAddrsInCct 2024-05-09T12:24:02.223 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] MonConfig.MonAddrsInCct (40 ms) 2024-05-09T12:24:02.223 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 3 tests from MonConfig (1105 ms total) 2024-05-09T12:24:02.223 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:02.223 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 5 tests from ACL 2024-05-09T12:24:02.223 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] ACL.SetACL 2024-05-09T12:24:02.250 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] ACL.SetACL (27 ms) 2024-05-09T12:24:02.250 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] ACL.Chmod 2024-05-09T12:24:02.275 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] ACL.Chmod (25 ms) 2024-05-09T12:24:02.275 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] ACL.DefaultACL 2024-05-09T12:24:02.319 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] ACL.DefaultACL (44 ms) 2024-05-09T12:24:02.319 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] ACL.Disabled 2024-05-09T12:24:02.367 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] ACL.Disabled (48 ms) 2024-05-09T12:24:02.367 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] ACL.SnapdirACL 2024-05-09T12:24:03.383 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] ACL.SnapdirACL (1016 ms) 2024-05-09T12:24:03.383 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 5 tests from ACL (1160 ms total) 2024-05-09T12:24:03.383 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:03.383 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from Caps 2024-05-09T12:24:03.383 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] Caps.ReadZero 2024-05-09T12:24:03.546 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] Caps.ReadZero (163 ms) 2024-05-09T12:24:03.546 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from Caps (163 ms total) 2024-05-09T12:24:03.546 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:03.546 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:03.546 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 126 tests from 4 test suites ran. (132890 ms total) 2024-05-09T12:24:03.547 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 126 tests. 2024-05-09T12:24:03.547 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:03.547 INFO:tasks.workunit.client.0.smithi188.stdout: YOU HAVE 4 DISABLED TESTS 2024-05-09T12:24:03.547 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:03.608 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 4 tests from 1 test suite. 2024-05-09T12:24:03.608 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:03.608 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 4 tests from AccessTest 2024-05-09T12:24:03.608 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] AccessTest.Foo 2024-05-09T12:24:03.628 INFO:tasks.workunit.client.0.smithi188.stdout:out: [{"entity":"client.libcephfs_foo_test.1619811310","key":"AQBjwDxmKzNwJRAA15CCgfT7wVDuqjzLec6QsQ==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2024-05-09T12:24:03.628 INFO:tasks.workunit.client.0.smithi188.stdout:key: AQBjwDxmKzNwJRAA15CCgfT7wVDuqjzLec6QsQ== 2024-05-09T12:24:03.652 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] AccessTest.Foo (44 ms) 2024-05-09T12:24:03.652 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] AccessTest.Path 2024-05-09T12:24:03.683 INFO:tasks.workunit.client.0.smithi188.stdout:out: [{"entity":"client.libcephfs_path_test.270977919","key":"AQBjwDxmPMu3KBAAvDzARs4ZAizYOSG4DsAXYQ==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.good.2063419110, allow rw path=/ceph_test_libcephfs_access.good_slash.395805715/","mon":"allow r","osd":"allow rwx"}}] 2024-05-09T12:24:03.683 INFO:tasks.workunit.client.0.smithi188.stdout:key: AQBjwDxmPMu3KBAAvDzARs4ZAizYOSG4DsAXYQ== 2024-05-09T12:24:05.775 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] AccessTest.Path (2123 ms) 2024-05-09T12:24:05.775 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] AccessTest.ReadOnly 2024-05-09T12:24:05.825 INFO:tasks.workunit.client.0.smithi188.stdout:out: [{"entity":"client.libcephfs_readonly_test.268408574","key":"AQBlwDxmVj0iMRAA6VOqpmrJef9OULAHY/TdZQ==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2024-05-09T12:24:05.825 INFO:tasks.workunit.client.0.smithi188.stdout:key: AQBlwDxmVj0iMRAA6VOqpmrJef9OULAHY/TdZQ== 2024-05-09T12:24:05.870 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] AccessTest.ReadOnly (95 ms) 2024-05-09T12:24:05.870 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] AccessTest.User 2024-05-09T12:24:05.915 INFO:tasks.workunit.client.0.smithi188.stdout:out: [{"entity":"client.libcephfs_user_test.165740744","key":"AQBlwDxmV6KDNhAA3tQluLOyDcqX5Kw57BWjBg==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2024-05-09T12:24:05.915 INFO:tasks.workunit.client.0.smithi188.stdout:key: AQBlwDxmV6KDNhAA3tQluLOyDcqX5Kw57BWjBg== 2024-05-09T12:24:06.015 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] AccessTest.User (145 ms) 2024-05-09T12:24:06.016 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 4 tests from AccessTest (2407 ms total) 2024-05-09T12:24:06.016 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:06.016 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:06.016 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 4 tests from 1 test suite ran. (2407 ms total) 2024-05-09T12:24:06.016 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 4 tests. 2024-05-09T12:24:06.053 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 1 test from 1 test suite. 2024-05-09T12:24:06.053 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:06.053 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS 2024-05-09T12:24:06.053 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ReclaimReset 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ReclaimReset (948 ms) 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS (948 ms total) 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 1 test from 1 test suite ran. (948 ms total) 2024-05-09T12:24:07.001 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 1 test. 2024-05-09T12:24:07.057 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 5 tests from 1 test suite. 2024-05-09T12:24:07.058 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:07.058 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 5 tests from LibCephFS 2024-05-09T12:24:07.058 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LazyIOOneWriterMulipleReaders 2024-05-09T12:24:07.116 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LazyIOOneWriterMulipleReaders (58 ms) 2024-05-09T12:24:07.116 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersMulipleReaders 2024-05-09T12:24:07.175 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersMulipleReaders (59 ms) 2024-05-09T12:24:07.175 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersOneReader 2024-05-09T12:24:07.227 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersOneReader (52 ms) 2024-05-09T12:24:07.227 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.LazyIOSynchronizeFlush 2024-05-09T12:24:07.279 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.LazyIOSynchronizeFlush (52 ms) 2024-05-09T12:24:07.280 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.WithoutandWithLazyIO 2024-05-09T12:24:07.336 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.WithoutandWithLazyIO (57 ms) 2024-05-09T12:24:07.336 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 5 tests from LibCephFS (278 ms total) 2024-05-09T12:24:07.336 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:07.337 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:07.337 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 5 tests from 1 test suite ran. (278 ms total) 2024-05-09T12:24:07.337 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 5 tests. 2024-05-09T12:24:07.373 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 1 test from 1 test suite. 2024-05-09T12:24:07.373 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:07.373 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS 2024-05-09T12:24:07.373 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.NewOPs 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.NewOPs (28 ms) 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS (28 ms total) 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 1 test from 1 test suite ran. (28 ms total) 2024-05-09T12:24:07.401 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 1 test. 2024-05-09T12:24:07.450 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 2 tests from 2 test suites. 2024-05-09T12:24:07.450 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:07.450 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from SuidsgidTest 2024-05-09T12:24:07.450 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] SuidsgidTest.WriteClearSetuid 2024-05-09T12:24:07.470 INFO:tasks.workunit.client.0.smithi188.stdout:out: [{"entity":"client.clear_suidsgid_1095723171","key":"AQBnwDxmQT4GHBAAzVtBRvy4XH/E0wCFVYYyqg==","caps":{"mds":"allow *","mgr":"allow *","mon":"allow *","osd":"allow *"}}] 2024-05-09T12:24:07.470 INFO:tasks.workunit.client.0.smithi188.stdout:key: AQBnwDxmQT4GHBAAzVtBRvy4XH/E0wCFVYYyqg== 2024-05-09T12:24:07.492 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06666 -> 0666 2024-05-09T12:24:07.499 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06676 -> 0676 2024-05-09T12:24:07.507 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06766 -> 0766 2024-05-09T12:24:07.515 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06777 -> 0777 2024-05-09T12:24:07.524 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06666 -> 06666 2024-05-09T12:24:07.525 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06676 -> 06676 2024-05-09T12:24:07.526 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06766 -> 06766 2024-05-09T12:24:07.528 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 06777 -> 06777 2024-05-09T12:24:07.535 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 02676 -> 0676 2024-05-09T12:24:07.543 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_fallocate, mode: 02777 -> 0777 2024-05-09T12:24:07.552 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_write, mode: 06766 -> 06766 2024-05-09T12:24:07.560 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_write, mode: 06766 -> 0766 2024-05-09T12:24:07.569 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_truncate size 10000 mode: 06766 -> 06766 2024-05-09T12:24:07.577 INFO:tasks.workunit.client.0.smithi188.stdout:After ceph_truncate size 100 mode: 06766 -> 0766 2024-05-09T12:24:07.585 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] SuidsgidTest.WriteClearSetuid (135 ms) 2024-05-09T12:24:07.585 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from SuidsgidTest (135 ms total) 2024-05-09T12:24:07.585 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:07.586 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS 2024-05-09T12:24:07.586 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.ChownClearSetuid 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.ChownClearSetuid (22 ms) 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 1 test from LibCephFS (22 ms total) 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 2 tests from 2 test suites ran. (157 ms total) 2024-05-09T12:24:07.607 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 2 tests. 2024-05-09T12:24:07.642 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] Running 7 tests from 1 test suite. 2024-05-09T12:24:07.642 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment set-up. 2024-05-09T12:24:07.642 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 7 tests from LibCephFS 2024-05-09T12:24:07.642 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapDiffLib 2024-05-09T12:24:07.719 INFO:tasks.workunit.client.0.smithi188.stdout:16 vs. 17 2024-05-09T12:24:07.719 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:10.692 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:15.690 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for / 2024-05-09T12:24:15.695 INFO:tasks.workunit.client.0.smithi188.stdout:dirB snap 17 2024-05-09T12:24:15.695 INFO:tasks.workunit.client.0.smithi188.stdout:fileB snap 17 2024-05-09T12:24:15.695 INFO:tasks.workunit.client.0.smithi188.stdout:fileC snap 16 2024-05-09T12:24:15.695 INFO:tasks.workunit.client.0.smithi188.stdout:fileA snap 17 2024-05-09T12:24:15.696 INFO:tasks.workunit.client.0.smithi188.stdout:dirC snap 16 2024-05-09T12:24:15.696 INFO:tasks.workunit.client.0.smithi188.stdout:dirD snap 17 2024-05-09T12:24:15.696 INFO:tasks.workunit.client.0.smithi188.stdout:dirA snap 17 2024-05-09T12:24:15.696 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:24:15.708 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-05-09T12:24:15.711 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-05-09T12:24:15.716 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2024-05-09T12:24:16.654 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:24:16.657 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:24:16.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:24:16.721 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-05-09T12:24:17.726 INFO:tasks.workunit.client.0.smithi188.stdout:---------invalid snapdiff params, the same snaps--------- 2024-05-09T12:24:17.728 INFO:tasks.workunit.client.0.smithi188.stdout:---------invalid snapdiff params, no snap_other --------- 2024-05-09T12:24:17.728 INFO:tasks.workunit.client.0.smithi188.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2024-05-09T12:24:17.728 INFO:tasks.workunit.client.0.smithi188.stderr: Failed to open snapdiff, ret:-22 2024-05-09T12:24:17.741 INFO:tasks.workunit.client.0.smithi188.stdout:------------- closing ------------- 2024-05-09T12:24:18.668 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapDiffLib (11026 ms) 2024-05-09T12:24:18.668 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2024-05-09T12:24:18.836 INFO:tasks.workunit.client.0.smithi188.stdout:20 vs. 21 vs. 22 2024-05-09T12:24:18.837 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:20.690 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.691 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.697 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:25.702 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.707 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.710 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for / 2024-05-09T12:24:25.714 INFO:tasks.workunit.client.0.smithi188.stdout:fileG snap 21 2024-05-09T12:24:25.715 INFO:tasks.workunit.client.0.smithi188.stdout:dirB snap 21 2024-05-09T12:24:25.715 INFO:tasks.workunit.client.0.smithi188.stdout:fileB snap 21 2024-05-09T12:24:25.715 INFO:tasks.workunit.client.0.smithi188.stdout:fileC snap 20 2024-05-09T12:24:25.715 INFO:tasks.workunit.client.0.smithi188.stdout:fileA snap 21 2024-05-09T12:24:25.715 INFO:tasks.workunit.client.0.smithi188.stdout:dirC snap 20 2024-05-09T12:24:25.716 INFO:tasks.workunit.client.0.smithi188.stdout:dirD snap 21 2024-05-09T12:24:25.716 INFO:tasks.workunit.client.0.smithi188.stdout:fileF snap 20 2024-05-09T12:24:25.716 INFO:tasks.workunit.client.0.smithi188.stdout:dirA snap 21 2024-05-09T12:24:25.716 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:24:25.721 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:25.726 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.729 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.733 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap1 diff listing verification for / 2024-05-09T12:24:25.738 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:25.741 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.746 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.748 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-05-09T12:24:25.752 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-05-09T12:24:25.757 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:25.760 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.763 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.766 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for /dirA 2024-05-09T12:24:25.768 INFO:tasks.workunit.client.0.smithi188.stdout:fileA snap 21 2024-05-09T12:24:25.768 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-05-09T12:24:25.771 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for /dirB 2024-05-09T12:24:25.774 INFO:tasks.workunit.client.0.smithi188.stdout:fileb snap 21 2024-05-09T12:24:25.774 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-05-09T12:24:25.777 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for /dirD 2024-05-09T12:24:25.780 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-05-09T12:24:25.782 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 listing verification--------- 2024-05-09T12:24:25.786 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 listing verification--------- 2024-05-09T12:24:25.789 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 listing verification--------- 2024-05-09T12:24:25.792 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:24:25.797 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap2 diff listing verification for / 2024-05-09T12:24:25.802 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-05-09T12:24:25.805 INFO:tasks.workunit.client.0.smithi188.stdout:------------- closing ------------- 2024-05-09T12:24:26.703 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapDiffLib2 (8036 ms) 2024-05-09T12:24:26.704 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2024-05-09T12:24:27.066 INFO:tasks.workunit.client.0.smithi188.stdout:26 vs. 27 2024-05-09T12:24:27.066 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing for / 2024-05-09T12:24:27.072 INFO:tasks.workunit.client.0.smithi188.stdout:C snap 26 2024-05-09T12:24:27.072 INFO:tasks.workunit.client.0.smithi188.stdout:L snap 27 2024-05-09T12:24:27.072 INFO:tasks.workunit.client.0.smithi188.stdout:S snap 27 2024-05-09T12:24:27.072 INFO:tasks.workunit.client.0.smithi188.stdout:T snap 27 2024-05-09T12:24:27.072 INFO:tasks.workunit.client.0.smithi188.stdout:d snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:G snap 26 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:l snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:e snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:~e snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:g snap 26 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:c snap 26 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:b snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:f snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:I snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:K snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:k snap 27 2024-05-09T12:24:27.073 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:24:27.077 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /S 2024-05-09T12:24:27.081 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /T 2024-05-09T12:24:27.085 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap1 diff listing verification for /C 2024-05-09T12:24:27.091 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2024-05-09T12:24:27.096 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /I 2024-05-09T12:24:27.099 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2024-05-09T12:24:27.102 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /L 2024-05-09T12:24:27.107 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2024-05-09T12:24:27.111 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2024-05-09T12:24:27.114 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2024-05-09T12:24:27.118 INFO:tasks.workunit.client.0.smithi188.stdout:------------- 2024-05-09T12:24:27.733 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (1029 ms) 2024-05-09T12:24:27.733 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2024-05-09T12:24:28.076 INFO:tasks.workunit.client.0.smithi188.stdout:33 vs. 34 2024-05-09T12:24:28.077 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing for / 2024-05-09T12:24:28.079 INFO:tasks.workunit.client.0.smithi188.stdout:H snap 34 2024-05-09T12:24:28.080 INFO:tasks.workunit.client.0.smithi188.stdout:L snap 34 2024-05-09T12:24:28.080 INFO:tasks.workunit.client.0.smithi188.stdout:S snap 34 2024-05-09T12:24:28.080 INFO:tasks.workunit.client.0.smithi188.stdout:ff snap 33 2024-05-09T12:24:28.080 INFO:tasks.workunit.client.0.smithi188.stdout:T snap 34 2024-05-09T12:24:28.080 INFO:tasks.workunit.client.0.smithi188.stdout:d snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:G snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:e snap 33 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:~e snap 33 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:g snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:b snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:f snap 33 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:I snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:a snap 34 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:K snap 33 2024-05-09T12:24:28.082 INFO:tasks.workunit.client.0.smithi188.stdout:k snap 33 2024-05-09T12:24:28.083 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-05-09T12:24:28.085 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /S 2024-05-09T12:24:28.088 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /T 2024-05-09T12:24:28.091 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /G 2024-05-09T12:24:28.094 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap2 diff listing verification for /K 2024-05-09T12:24:28.098 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /H 2024-05-09T12:24:28.101 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /I 2024-05-09T12:24:28.105 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2024-05-09T12:24:28.108 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /L 2024-05-09T12:24:28.113 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2024-05-09T12:24:28.116 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2024-05-09T12:24:28.119 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2024-05-09T12:24:28.760 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (1027 ms) 2024-05-09T12:24:28.760 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2024-05-09T12:24:29.089 INFO:tasks.workunit.client.0.smithi188.stdout:38 vs. 40 2024-05-09T12:24:29.089 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing for / 2024-05-09T12:24:29.092 INFO:tasks.workunit.client.0.smithi188.stdout:C snap 38 2024-05-09T12:24:29.092 INFO:tasks.workunit.client.0.smithi188.stdout:H snap 40 2024-05-09T12:24:29.092 INFO:tasks.workunit.client.0.smithi188.stdout:L snap 40 2024-05-09T12:24:29.093 INFO:tasks.workunit.client.0.smithi188.stdout:S snap 40 2024-05-09T12:24:29.093 INFO:tasks.workunit.client.0.smithi188.stdout:ff snap 38 2024-05-09T12:24:29.094 INFO:tasks.workunit.client.0.smithi188.stdout:T snap 40 2024-05-09T12:24:29.094 INFO:tasks.workunit.client.0.smithi188.stdout:d snap 40 2024-05-09T12:24:29.094 INFO:tasks.workunit.client.0.smithi188.stdout:G snap 38 2024-05-09T12:24:29.094 INFO:tasks.workunit.client.0.smithi188.stdout:G snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:l snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:e snap 38 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:~e snap 38 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:g snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:c snap 38 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:b snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:f snap 38 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:I snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:a snap 40 2024-05-09T12:24:29.095 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for / 2024-05-09T12:24:29.098 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for /S 2024-05-09T12:24:29.101 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for /T 2024-05-09T12:24:29.105 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for /C 2024-05-09T12:24:29.108 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2024-05-09T12:24:29.112 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /G 2024-05-09T12:24:29.114 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap3 vs. snap1 diff listing verification for /G 2024-05-09T12:24:29.117 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /H 2024-05-09T12:24:29.121 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /I 2024-05-09T12:24:29.124 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2024-05-09T12:24:29.127 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /L 2024-05-09T12:24:29.132 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2024-05-09T12:24:29.136 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2024-05-09T12:24:29.139 INFO:tasks.workunit.client.0.smithi188.stdout:------------- 2024-05-09T12:24:29.785 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (1025 ms) 2024-05-09T12:24:29.785 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2024-05-09T12:24:46.796 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:24:46.800 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:24:46.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:09.733 INFO:tasks.workunit.client.0.smithi188.stdout:Seeding 10000 files... 2024-05-09T12:25:09.733 INFO:tasks.workunit.client.0.smithi188.stdout:44 vs. 45 2024-05-09T12:25:09.733 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:25:09.761 INFO:tasks.workunit.client.0.smithi188.stdout:------------- closing ------------- 2024-05-09T12:25:17.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:17.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:17.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:47.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:47.294 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:47.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:25:51.322 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (81537 ms) 2024-05-09T12:25:51.323 INFO:tasks.workunit.client.0.smithi188.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2024-05-09T12:26:17.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:26:17.446 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:26:17.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:26:47.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:26:47.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:26:47.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:17.968 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:17.973 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:17.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:48.108 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:48.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:27:48.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:18.447 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:18.451 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:18.453 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:45.205 INFO:tasks.workunit.client.0.smithi188.stdout:Seeding 15100 files... 2024-05-09T12:28:45.205 INFO:tasks.workunit.client.0.smithi188.stdout:48 vs. 49 2024-05-09T12:28:45.206 INFO:tasks.workunit.client.0.smithi188.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-05-09T12:28:46.614 INFO:tasks.workunit.client.0.smithi188.stdout:------------- closing ------------- 2024-05-09T12:28:48.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:48.723 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:48.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T12:28:48.762 INFO:tasks.ceph.mds.a.smithi135.stderr:2024-05-09T12:28:48.762+0000 7fa3fff1d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 35647) UID: 0 2024-05-09T12:29:26.892 INFO:tasks.workunit.client.0.smithi188.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (215569 ms) 2024-05-09T12:29:26.892 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] 7 tests from LibCephFS (319249 ms total) 2024-05-09T12:29:26.892 INFO:tasks.workunit.client.0.smithi188.stdout: 2024-05-09T12:29:26.892 INFO:tasks.workunit.client.0.smithi188.stdout:[----------] Global test environment tear-down 2024-05-09T12:29:26.892 INFO:tasks.workunit.client.0.smithi188.stdout:[==========] 7 tests from 1 test suite ran. (319249 ms total) 2024-05-09T12:29:26.893 INFO:tasks.workunit.client.0.smithi188.stdout:[ PASSED ] 7 tests. 2024-05-09T12:29:26.895 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T12:29:26.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T12:29:26.934 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2024-05-09T12:29:26.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T12:29:27.263 DEBUG:teuthology.parallel:result is None 2024-05-09T12:29:27.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T12:29:27.293 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T12:29:27.293 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-09T12:29:27.304 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-09T12:29:27.304 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:29:27.304 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T12:29:27.349 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:29:27.349 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T12:29:27.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T12:29:27.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.546+0000 7f9e8ef17640 1 Processor -- start 2024-05-09T12:29:27.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.546+0000 7f9e8ef17640 1 -- start start 2024-05-09T12:29:27.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ef17640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9e88137b40 0x7f9e8809c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ef17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e881407c0 0x7f9e88142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ef17640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e880ab650 con 0x7f9e88137760 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ef17640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f9e880736e0 con 0x7f9e88137b40 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ef17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88073990 con 0x7f9e881407c0 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ccb3640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f9e88137760 0x7f9e8809bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:48654/0 (socket says 172.21.15.135:48654) 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e8ccb3640 1 -- 172.21.15.135:0/827437534 learned_addr learned my addr 172.21.15.135:0/827437534 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.547+0000 7f9e87fff640 1 --2- 172.21.15.135:0/827437534 >> v2:172.21.15.160:3300/0 conn(0x7f9e88137b40 0x7f9e8809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.548+0000 7f9e8d4b4640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e881407c0 0x7f9e88142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.548+0000 7f9e87fff640 1 -- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e881407c0 msgr2=0x7f9e88142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.548+0000 7f9e87fff640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e881407c0 0x7f9e88142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.548+0000 7f9e87fff640 1 -- 172.21.15.135:0/827437534 >> v1:172.21.15.160:6789/0 conn(0x7f9e88137760 legacy=0x7f9e8809bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.548+0000 7f9e87fff640 1 -- 172.21.15.135:0/827437534 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e88073f30 con 0x7f9e88137b40 2024-05-09T12:29:27.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.549+0000 7f9e87fff640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e88137b40 0x7f9e8809c480 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9e740097a0 tx=0x7f9e7402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70695eca6a21461 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:27.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.549+0000 7f9e877fe640 1 -- 172.21.15.135:0/827437534 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740315a0 con 0x7f9e88137b40 2024-05-09T12:29:27.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.550+0000 7f9e877fe640 1 -- 172.21.15.135:0/827437534 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e74037070 con 0x7f9e88137b40 2024-05-09T12:29:27.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.550+0000 7f9e877fe640 1 -- 172.21.15.135:0/827437534 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74031960 con 0x7f9e88137b40 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.550+0000 7f9e8ef17640 1 -- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e88137b40 msgr2=0x7f9e8809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.550+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e88137b40 0x7f9e8809c480 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9e740097a0 tx=0x7f9e7402b840 comp rx=0 tx=0).stop 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 -- 172.21.15.135:0/827437534 shutdown_connections 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e881407c0 0x7f9e88142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/827437534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e88137b40 0x7f9e8809c480 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 -- 172.21.15.135:0/827437534 >> 172.21.15.135:0/827437534 conn(0x7f9e880aa930 msgr2=0x7f9e880aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 -- 172.21.15.135:0/827437534 shutdown_connections 2024-05-09T12:29:27.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.551+0000 7f9e8ef17640 1 -- 172.21.15.135:0/827437534 wait complete. 2024-05-09T12:29:27.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.552+0000 7f9e8ef17640 1 Processor -- start 2024-05-09T12:29:27.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.552+0000 7f9e8ef17640 1 -- start start 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e88137b40 0x7f9e880a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e881407c0 0x7f9e88140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88073380 con 0x7f9e88137760 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e880a79d0 con 0x7f9e881407c0 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ef17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9e880703c0 con 0x7f9e88137b40 2024-05-09T12:29:27.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34352/0 (socket says 172.21.15.135:34352) 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 -- 172.21.15.135:0/3642791880 learned_addr learned my addr 172.21.15.135:0/3642791880 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e87fff640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e88137b40 0x7f9e880a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8d4b4640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e881407c0 0x7f9e88140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 -- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e88137b40 msgr2=0x7f9e880a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e88137b40 0x7f9e880a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 -- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e881407c0 msgr2=0x7f9e88140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e881407c0 0x7f9e88140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.553+0000 7f9e8ccb3640 1 -- 172.21.15.135:0/3642791880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8813aca0 con 0x7f9e88137760 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e8ccb3640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c500 tx=0x7f9e7c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c017070 con 0x7f9e88137760 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c005d00 con 0x7f9e88137760 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c007330 con 0x7f9e88137760 2024-05-09T12:29:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881433f0 con 0x7f9e88137760 2024-05-09T12:29:27.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.554+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e88140350 con 0x7f9e88137760 2024-05-09T12:29:27.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.556+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e88071710 con 0x7f9e88137760 2024-05-09T12:29:27.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.557+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e7c01a070 con 0x7f9e88137760 2024-05-09T12:29:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.557+0000 7f9e857fa640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.558+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f9e7c096460 con 0x7f9e88137760 2024-05-09T12:29:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.558+0000 7f9e87fff640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:27.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.558+0000 7f9e87fff640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 0x7f9e6c0787c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:27.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.563+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e7c05fc30 con 0x7f9e88137760 2024-05-09T12:29:27.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.863+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9e881405a0 con 0x7f9e88137760 2024-05-09T12:29:27.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.863+0000 7f9e857fa640 1 -- 172.21.15.135:0/3642791880 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v34) ==== 80+0+59 (secure 0 0 0) 0x7f9e7c068270 con 0x7f9e88137760 2024-05-09T12:29:27.865 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.188:0/1749211825 2024-05-09T13:24:06.124315+0000 2024-05-09T12:29:27.865 INFO:teuthology.orchestra.run.smithi135.stderr:listed 1 entries 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 msgr2=0x7f9e6c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 0x7f9e6c0787c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e74036000 tx=0x7f9e7403d040 comp rx=0 tx=0).stop 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 msgr2=0x7f9e880a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c500 tx=0x7f9e7c00c9c0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 shutdown_connections 2024-05-09T12:29:27.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e881407c0 0x7f9e88140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e88137b40 0x7f9e880a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 --2- 172.21.15.135:0/3642791880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88137760 0x7f9e880a67c0 secure :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c500 tx=0x7f9e7c00c9c0 comp rx=0 tx=0).stop 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.867+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 >> 172.21.15.135:0/3642791880 conn(0x7f9e880aa930 msgr2=0x7f9e880a87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.868+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 shutdown_connections 2024-05-09T12:29:27.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:27.868+0000 7f9e8ef17640 1 -- 172.21.15.135:0/3642791880 wait complete. 2024-05-09T12:29:27.885 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-05-09T12:29:27.885 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T12:29:27.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.062+0000 7f26f2433640 1 Processor -- start 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.062+0000 7f26f2433640 1 -- start start 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f2433640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec0a4ba0 0x7f26ec0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f2433640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26ec0752a0 0x7f26ec135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f2433640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ec0a3b10 con 0x7f26ec1363e0 2024-05-09T12:29:28.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f2433640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f26ec0a38f0 con 0x7f26ec0752a0 2024-05-09T12:29:28.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f2433640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f26ec0a2b90 con 0x7f26ec0a4ba0 2024-05-09T12:29:28.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f09d0640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f26ec1363e0 0x7f26ec138c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36316/0 (socket says 172.21.15.135:36316) 2024-05-09T12:29:28.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.063+0000 7f26f09d0640 1 -- 172.21.15.135:0/2417670778 learned_addr learned my addr 172.21.15.135:0/2417670778 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:28.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26ebfff640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec0a4ba0 0x7f26ec0a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2417670778 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0752a0 0x7f26ec135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26eb7fe640 1 -- 172.21.15.135:0/2417670778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec0a4ba0 msgr2=0x7f26ec0a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:28.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec0a4ba0 0x7f26ec0a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26eb7fe640 1 -- 172.21.15.135:0/2417670778 >> v1:172.21.15.135:6789/0 conn(0x7f26ec1363e0 legacy=0x7f26ec138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:28.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.064+0000 7f26eb7fe640 1 -- 172.21.15.135:0/2417670778 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec0a3f00 con 0x7f26ec0752a0 2024-05-09T12:29:28.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.065+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0752a0 0x7f26ec135ea0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009d90 tx=0x7f26e402bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71a0beaa1a3eee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:28.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.066+0000 7f26eaffd640 1 -- 172.21.15.135:0/2417670778 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e402d920 con 0x7f26ec0752a0 2024-05-09T12:29:28.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.066+0000 7f26eaffd640 1 -- 172.21.15.135:0/2417670778 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e402dac0 con 0x7f26ec0752a0 2024-05-09T12:29:28.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.066+0000 7f26eaffd640 1 -- 172.21.15.135:0/2417670778 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e402c440 con 0x7f26ec0752a0 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 -- 172.21.15.135:0/2417670778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0752a0 msgr2=0x7f26ec135ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0752a0 0x7f26ec135ea0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009d90 tx=0x7f26e402bbe0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 -- 172.21.15.135:0/2417670778 shutdown_connections 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0752a0 0x7f26ec135ea0 secure :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009d90 tx=0x7f26e402bbe0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 --2- 172.21.15.135:0/2417670778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec0a4ba0 0x7f26ec0a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.068+0000 7f26f2433640 1 -- 172.21.15.135:0/2417670778 >> 172.21.15.135:0/2417670778 conn(0x7f26ec0aaf90 msgr2=0x7f26ec0ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.069+0000 7f26f2433640 1 -- 172.21.15.135:0/2417670778 shutdown_connections 2024-05-09T12:29:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.069+0000 7f26f2433640 1 -- 172.21.15.135:0/2417670778 wait complete. 2024-05-09T12:29:28.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.072+0000 7f26f2433640 1 Processor -- start 2024-05-09T12:29:28.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.074+0000 7f26f2433640 1 -- start start 2024-05-09T12:29:28.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 0x7f26ec1d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec1363e0 0x7f26ec1d7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec13d0c0 con 0x7f26ec0a4ba0 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec13cf40 con 0x7f26ec1363e0 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f2433640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f26ec0a2dc0 con 0x7f26ec1d7650 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:39326/0 (socket says 172.21.15.135:39326) 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 -- 172.21.15.135:0/3518812411 learned_addr learned my addr 172.21.15.135:0/3518812411 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26eb7fe640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec1363e0 0x7f26ec1d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 -- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec1363e0 msgr2=0x7f26ec1d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec1363e0 0x7f26ec1d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26f09d0640 1 -- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 msgr2=0x7f26ec1d6bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T12:29:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.075+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 0x7f26ec1d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.076+0000 7f26f09d0640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 0x7f26ec1d6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.076+0000 7f26f09d0640 1 -- 172.21.15.135:0/3518812411 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec124ec0 con 0x7f26ec1d7650 2024-05-09T12:29:28.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.076+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 0x7f26ec1d6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:29:28.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.076+0000 7f26f09d0640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c730 tx=0x7f26dc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:28.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.077+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc018070 con 0x7f26ec1d7650 2024-05-09T12:29:28.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.077+0000 7f26f2433640 1 -- 172.21.15.135:0/3518812411 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec123190 con 0x7f26ec1d7650 2024-05-09T12:29:28.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.078+0000 7f26f2433640 1 -- 172.21.15.135:0/3518812411 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec1273b0 con 0x7f26ec1d7650 2024-05-09T12:29:28.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.078+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc0072d0 con 0x7f26ec1d7650 2024-05-09T12:29:28.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.078+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0047e0 con 0x7f26ec1d7650 2024-05-09T12:29:28.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.080+0000 7f26f2433640 1 -- 172.21.15.135:0/3518812411 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc005080 con 0x7f26ec1d7650 2024-05-09T12:29:28.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.082+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f26dc01b070 con 0x7f26ec1d7650 2024-05-09T12:29:28.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.083+0000 7f26e8ff9640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 0x7f26d8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:28.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.083+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 0x7f26d8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:28.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.084+0000 7f26ebfff640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 0x7f26d8078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:28.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.084+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f26dc096920 con 0x7f26ec1d7650 2024-05-09T12:29:28.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.091+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f26dc03b020 con 0x7f26ec1d7650 2024-05-09T12:29:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.482+0000 7f26f2433640 1 -- 172.21.15.135:0/3518812411 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26cc005640 con 0x7f26ec1d7650 2024-05-09T12:29:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.483+0000 7f26e8ff9640 1 -- 172.21.15.135:0/3518812411 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v34) ==== 80+0+59 (secure 0 0 0) 0x7f26dc060170 con 0x7f26ec1d7650 2024-05-09T12:29:28.485 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.188:0/1749211825 2024-05-09T13:24:06.124315+0000 2024-05-09T12:29:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:listed 1 entries 2024-05-09T12:29:28.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 msgr2=0x7f26d8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:28.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 0x7f26d8078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0008040 comp rx=0 tx=0).stop 2024-05-09T12:29:28.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 msgr2=0x7f26ec126040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:28.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c730 tx=0x7f26dc00cbf0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 shutdown_connections 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f26d80763a0 0x7f26d8078860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26ec1d7650 0x7f26ec126040 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26ec1363e0 0x7f26ec1d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 --2- 172.21.15.135:0/3518812411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0a4ba0 0x7f26ec1d6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.488+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 >> 172.21.15.135:0/3518812411 conn(0x7f26ec0aaf90 msgr2=0x7f26ec129a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.489+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 shutdown_connections 2024-05-09T12:29:28.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:28.489+0000 7f26d27fc640 1 -- 172.21.15.135:0/3518812411 wait complete. 2024-05-09T12:29:28.509 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi188.front.sepia.ceph.com... 2024-05-09T12:29:28.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:29:28.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-09T12:29:28.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi188.stderr:ceph-fuse[27218]: fuse finished with error 0 and tester_r 0 2024-05-09T12:29:28.539 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:29:34.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2024-05-09T12:29:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:29:34.641 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T12:29:34.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:29:34.705 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-05-09T12:29:34.723 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T12:29:34.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:29:34.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T12:29:34.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T12:29:34.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-05-09T12:29:34.894 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T12:29:34.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T12:29:34.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:29:35.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.049+0000 7fc709f26640 1 Processor -- start 2024-05-09T12:29:35.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.049+0000 7fc709f26640 1 -- start start 2024-05-09T12:29:35.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.050+0000 7fc709f26640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc7041402f0 0x7fc7041426e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.050+0000 7fc7037fe640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc704136390 0x7fc704136770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:36506/0 (socket says 172.21.15.135:36506) 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.050+0000 7fc703fff640 1 --2- 172.21.15.135:0/408379012 >> v2:172.21.15.160:3300/0 conn(0x7fc7041402f0 0x7fc7041426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.050+0000 7fc7037fe640 1 -- 172.21.15.135:0/408379012 learned_addr learned my addr 172.21.15.135:0/408379012 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.050+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc704071be0 con 0x7fc70413c7e0 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.051+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc704071310 con 0x7fc704136390 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.051+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fc70409df70 con 0x7fc7041402f0 2024-05-09T12:29:35.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.051+0000 7fc703fff640 1 -- 172.21.15.135:0/408379012 >> v1:172.21.15.160:6789/0 conn(0x7fc704136390 legacy=0x7fc704136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.051+0000 7fc703fff640 1 -- 172.21.15.135:0/408379012 >> v1:172.21.15.135:6789/0 conn(0x7fc70413c7e0 legacy=0x7fc70413ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.051+0000 7fc703fff640 1 -- 172.21.15.135:0/408379012 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc704072aa0 con 0x7fc7041402f0 2024-05-09T12:29:35.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.052+0000 7fc703fff640 1 --2- 172.21.15.135:0/408379012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc7041426e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009d90 tx=0x7fc6fc02bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6b5d7509dc1db7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.052+0000 7fc7027fc640 1 -- 172.21.15.135:0/408379012 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc039070 con 0x7fc7041402f0 2024-05-09T12:29:35.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.052+0000 7fc7027fc640 1 -- 172.21.15.135:0/408379012 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc02ca50 con 0x7fc7041402f0 2024-05-09T12:29:35.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.052+0000 7fc7027fc640 1 -- 172.21.15.135:0/408379012 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc02ce20 con 0x7fc7041402f0 2024-05-09T12:29:35.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 msgr2=0x7fc7041426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 --2- 172.21.15.135:0/408379012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc7041426e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009d90 tx=0x7fc6fc02bd20 comp rx=0 tx=0).stop 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 shutdown_connections 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 --2- 172.21.15.135:0/408379012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc7041426e0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 >> 172.21.15.135:0/408379012 conn(0x7fc7040aba90 msgr2=0x7fc7040abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 shutdown_connections 2024-05-09T12:29:35.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.053+0000 7fc709f26640 1 -- 172.21.15.135:0/408379012 wait complete. 2024-05-09T12:29:35.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.055+0000 7fc709f26640 1 Processor -- start 2024-05-09T12:29:35.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.055+0000 7fc709f26640 1 -- start start 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 0x7fc70409f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc70409fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc70409d860 con 0x7fc70413c7e0 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040742b0 con 0x7fc7041402f0 2024-05-09T12:29:35.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc709f26640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc704071920 con 0x7fc704136390 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc7037fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc7037fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57262/0 (socket says 172.21.15.135:57262) 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc7037fe640 1 -- 172.21.15.135:0/3593026564 learned_addr learned my addr 172.21.15.135:0/3593026564 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.056+0000 7fc702ffd640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 0x7fc70409f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc703fff640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc70409fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 -- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 msgr2=0x7fc70409fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc70409fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 -- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 msgr2=0x7fc70409f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 0x7fc70409f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 -- 172.21.15.135:0/3593026564 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040a2210 con 0x7fc704136390 2024-05-09T12:29:35.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.057+0000 7fc7037fe640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c650 tx=0x7fc6f800cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8018070 con 0x7fc704136390 2024-05-09T12:29:35.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f80072f0 con 0x7fc704136390 2024-05-09T12:29:35.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80047e0 con 0x7fc704136390 2024-05-09T12:29:35.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7040a0eb0 con 0x7fc704136390 2024-05-09T12:29:35.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7040a8f30 con 0x7fc704136390 2024-05-09T12:29:35.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.058+0000 7fc702ffd640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 0x7fc70409f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:29:35.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.059+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7040508d0 con 0x7fc704136390 2024-05-09T12:29:35.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.062+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc6f8004980 con 0x7fc704136390 2024-05-09T12:29:35.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.062+0000 7fc6ebfff640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 0x7fc6f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.062+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fc6f8096870 con 0x7fc704136390 2024-05-09T12:29:35.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.062+0000 7fc702ffd640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 0x7fc6f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.063+0000 7fc702ffd640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 0x7fc6f0078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4007fd0 tx=0x7fc6f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.066+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6f8004c70 con 0x7fc704136390 2024-05-09T12:29:35.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.436+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7040a2710 con 0x7fc6f00762d0 2024-05-09T12:29:35.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.445+0000 7fc6ebfff640 1 -- 172.21.15.135:0/3593026564 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+273971 (secure 0 0 0) 0x7fc7040a2710 con 0x7fc6f00762d0 2024-05-09T12:29:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:29:35.451 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 msgr2=0x7fc6f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 0x7fc6f0078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4007fd0 tx=0x7fc6f4009040 comp rx=0 tx=0).stop 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 msgr2=0x7fc70409f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c650 tx=0x7fc6f800cb10 comp rx=0 tx=0).stop 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 shutdown_connections 2024-05-09T12:29:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fc6f00762d0 0x7fc6f0078790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7041402f0 0x7fc70409fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc70413c7e0 0x7fc70409f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 --2- 172.21.15.135:0/3593026564 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc704136390 0x7fc70409f0e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.449+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 >> 172.21.15.135:0/3593026564 conn(0x7fc7040aba90 msgr2=0x7fc704135240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.450+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 shutdown_connections 2024-05-09T12:29:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.450+0000 7fc709f26640 1 -- 172.21.15.135:0/3593026564 wait complete. 2024-05-09T12:29:35.467 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-05-09T12:29:33.484833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":288119415,"num_objects":38621,"num_object_clones":23812,"num_object_copies":77242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38621,"num_whiteouts":14575,"num_read":255,"num_read_kb":3256,"num_write":164634,"num_write_kb":617687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243576,"ondisk_log_size":243576,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3122976,"kb_used_data":760416,"kb_used_omap":6,"kb_used_meta":2362489,"kb_avail":374364384,"statfs":{"total":386547056640,"available":383349129216,"internally_reserved":0,"allocated":778665984,"data_stored":576801545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2419189526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,7,7,6,8,8,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4976244,"num_objects":-5118,"num_object_clones":-4575,"num_object_copies":-10236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5118,"num_whiteouts":1299,"num_read":3,"num_read_kb":184,"num_write":1879,"num_write_kb":4948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001684"},"pg_stats":[{"pgid":"4.3f","version":"34'2238","reported_seq":1843,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.918603+0000","last_change":"2024-05-09T12:29:25.988746+0000","last_active":"2024-05-09T12:29:28.918603+0000","last_peered":"2024-05-09T12:29:28.918603+0000","last_clean":"2024-05-09T12:29:28.918603+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:29:28.918603+0000","last_undegraded":"2024-05-09T12:29:28.918603+0000","last_fullsized":"2024-05-09T12:29:28.918603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2238,"log_dups_size":0,"ondisk_log_size":2238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:08:18.309520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2013429659999999,"stat_sum":{"num_bytes":4656,"num_objects":622,"num_object_clones":406,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":622,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2813","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.865638+0000","last_change":"2024-05-09T12:29:27.421182+0000","last_active":"2024-05-09T12:29:28.865638+0000","last_peered":"2024-05-09T12:29:28.865638+0000","last_clean":"2024-05-09T12:29:28.865638+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:29:28.865638+0000","last_undegraded":"2024-05-09T12:29:28.865638+0000","last_fullsized":"2024-05-09T12:29:28.865638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2813,"log_dups_size":0,"ondisk_log_size":2813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:35:26.401558+0000","scrub_duration":0,"objects_trimmed":64,"snaptrim_duration":0.42135249400000002,"stat_sum":{"num_bytes":2304,"num_objects":384,"num_object_clones":192,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":384,"num_whiteouts":192,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3d","version":"34'2421","reported_seq":2036,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.960098+0000","last_change":"2024-05-09T12:29:25.993369+0000","last_active":"2024-05-09T12:29:28.960098+0000","last_peered":"2024-05-09T12:29:28.960098+0000","last_clean":"2024-05-09T12:29:28.960098+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:28.960098+0000","last_undegraded":"2024-05-09T12:29:28.960098+0000","last_fullsized":"2024-05-09T12:29:28.960098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2421,"log_dups_size":0,"ondisk_log_size":2421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4094307000000001,"stat_sum":{"num_bytes":4940,"num_objects":665,"num_object_clones":432,"num_object_copies":1330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":233,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'3004","reported_seq":2413,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.065797+0000","last_change":"2024-05-09T12:29:29.065840+0000","last_active":"2024-05-09T12:29:29.065797+0000","last_peered":"2024-05-09T12:29:29.065797+0000","last_clean":"2024-05-09T12:29:29.065797+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:29:29.065797+0000","last_undegraded":"2024-05-09T12:29:29.065797+0000","last_fullsized":"2024-05-09T12:29:29.065797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3004,"log_dups_size":0,"ondisk_log_size":3004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":2.066871688,"stat_sum":{"num_bytes":6936,"num_objects":470,"num_object_clones":234,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3b","version":"34'2489","reported_seq":2071,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962721+0000","last_change":"2024-05-09T12:29:25.988863+0000","last_active":"2024-05-09T12:29:28.962721+0000","last_peered":"2024-05-09T12:29:28.962721+0000","last_clean":"2024-05-09T12:29:28.962721+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:28.962721+0000","last_undegraded":"2024-05-09T12:29:28.962721+0000","last_fullsized":"2024-05-09T12:29:28.962721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2489,"log_dups_size":0,"ondisk_log_size":2489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2016601869999999,"stat_sum":{"num_bytes":5152,"num_objects":692,"num_object_clones":448,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":243,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2549","reported_seq":2119,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.503882+0000","last_change":"2024-05-09T12:29:29.300920+0000","last_active":"2024-05-09T12:29:29.503882+0000","last_peered":"2024-05-09T12:29:29.503882+0000","last_clean":"2024-05-09T12:29:29.503882+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:29.503882+0000","last_undegraded":"2024-05-09T12:29:29.503882+0000","last_fullsized":"2024-05-09T12:29:29.503882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2549,"log_dups_size":0,"ondisk_log_size":2549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":60,"snaptrim_duration":3.407217851,"stat_sum":{"num_bytes":4560,"num_objects":632,"num_object_clones":395,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":235,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"34'2840","reported_seq":2333,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950993+0000","last_change":"2024-05-09T12:29:27.270399+0000","last_active":"2024-05-09T12:29:28.950993+0000","last_peered":"2024-05-09T12:29:28.950993+0000","last_clean":"2024-05-09T12:29:28.950993+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:29:28.950993+0000","last_undegraded":"2024-05-09T12:29:28.950993+0000","last_fullsized":"2024-05-09T12:29:28.950993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":40,"snaptrim_duration":0.26985108400000002,"stat_sum":{"num_bytes":2448,"num_objects":411,"num_object_clones":204,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":411,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.38","version":"34'2735","reported_seq":2226,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.955573+0000","last_change":"2024-05-09T12:29:27.368044+0000","last_active":"2024-05-09T12:29:28.955573+0000","last_peered":"2024-05-09T12:29:28.955573+0000","last_clean":"2024-05-09T12:29:28.955573+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:28.955573+0000","last_undegraded":"2024-05-09T12:29:28.955573+0000","last_fullsized":"2024-05-09T12:29:28.955573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":56,"snaptrim_duration":0.36738837800000002,"stat_sum":{"num_bytes":6556,"num_objects":413,"num_object_clones":206,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.37","version":"34'2483","reported_seq":2060,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.926970+0000","last_change":"2024-05-09T12:29:25.988396+0000","last_active":"2024-05-09T12:29:28.926970+0000","last_peered":"2024-05-09T12:29:28.926970+0000","last_clean":"2024-05-09T12:29:28.926970+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:28.926970+0000","last_undegraded":"2024-05-09T12:29:28.926970+0000","last_fullsized":"2024-05-09T12:29:28.926970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2483,"log_dups_size":0,"ondisk_log_size":2483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2001041780000001,"stat_sum":{"num_bytes":9153,"num_objects":678,"num_object_clones":440,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":678,"num_whiteouts":234,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'2098","reported_seq":1743,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.851879+0000","last_change":"2024-05-09T12:29:25.992555+0000","last_active":"2024-05-09T12:29:28.851879+0000","last_peered":"2024-05-09T12:29:28.851879+0000","last_clean":"2024-05-09T12:29:28.851879+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:29:28.851879+0000","last_undegraded":"2024-05-09T12:29:28.851879+0000","last_fullsized":"2024-05-09T12:29:28.851879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:40.886862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4075880070000002,"stat_sum":{"num_bytes":8683,"num_objects":615,"num_object_clones":400,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":615,"num_whiteouts":213,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"34'2587","reported_seq":2113,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.939132+0000","last_change":"2024-05-09T12:29:27.177743+0000","last_active":"2024-05-09T12:29:28.939132+0000","last_peered":"2024-05-09T12:29:28.939132+0000","last_clean":"2024-05-09T12:29:28.939132+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:28.939132+0000","last_undegraded":"2024-05-09T12:29:28.939132+0000","last_fullsized":"2024-05-09T12:29:28.939132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2587,"log_dups_size":0,"ondisk_log_size":2587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:19:09.204008+0000","scrub_duration":0,"objects_trimmed":29,"snaptrim_duration":0.17742645300000001,"stat_sum":{"num_bytes":6436,"num_objects":394,"num_object_clones":195,"num_object_copies":788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":394,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.34","version":"34'2503","reported_seq":2025,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.538076+0000","last_change":"2024-05-09T12:29:28.747434+0000","last_active":"2024-05-09T12:29:29.538076+0000","last_peered":"2024-05-09T12:29:29.538076+0000","last_clean":"2024-05-09T12:29:29.538076+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:29.538076+0000","last_undegraded":"2024-05-09T12:29:29.538076+0000","last_fullsized":"2024-05-09T12:29:29.538076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:31.554547+0000","scrub_duration":0,"objects_trimmed":142,"snaptrim_duration":2.7081342720000001,"stat_sum":{"num_bytes":3936,"num_objects":578,"num_object_clones":340,"num_object_copies":1156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":236,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'2859","reported_seq":2362,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.340953+0000","last_change":"2024-05-09T12:29:29.340994+0000","last_active":"2024-05-09T12:29:29.340953+0000","last_peered":"2024-05-09T12:29:29.340953+0000","last_clean":"2024-05-09T12:29:29.340953+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:29:29.340953+0000","last_undegraded":"2024-05-09T12:29:29.340953+0000","last_fullsized":"2024-05-09T12:29:29.340953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2859,"log_dups_size":0,"ondisk_log_size":2859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":2.3344210159999998,"stat_sum":{"num_bytes":6388,"num_objects":385,"num_object_clones":191,"num_object_copies":770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":191,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.32","version":"34'2570","reported_seq":2139,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.953401+0000","last_change":"2024-05-09T12:29:25.990783+0000","last_active":"2024-05-09T12:29:28.953401+0000","last_peered":"2024-05-09T12:29:28.953401+0000","last_clean":"2024-05-09T12:29:28.953401+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:28.953401+0000","last_undegraded":"2024-05-09T12:29:28.953401+0000","last_fullsized":"2024-05-09T12:29:28.953401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2570,"log_dups_size":0,"ondisk_log_size":2570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.680743933,"stat_sum":{"num_bytes":5365,"num_objects":723,"num_object_clones":469,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":723,"num_whiteouts":252,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"34'2767","reported_seq":2277,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.490781+0000","last_change":"2024-05-09T12:29:28.402195+0000","last_active":"2024-05-09T12:29:29.490781+0000","last_peered":"2024-05-09T12:29:29.490781+0000","last_clean":"2024-05-09T12:29:29.490781+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:29:29.490781+0000","last_undegraded":"2024-05-09T12:29:29.490781+0000","last_fullsized":"2024-05-09T12:29:29.490781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2767,"log_dups_size":0,"ondisk_log_size":2767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:53.594808+0000","scrub_duration":0,"objects_trimmed":163,"snaptrim_duration":3.6793151659999999,"stat_sum":{"num_bytes":7751,"num_objects":541,"num_object_clones":314,"num_object_copies":1082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":541,"num_whiteouts":225,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'2851","reported_seq":2318,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.110824+0000","last_change":"2024-05-09T12:29:29.110851+0000","last_active":"2024-05-09T12:29:29.110824+0000","last_peered":"2024-05-09T12:29:29.110824+0000","last_clean":"2024-05-09T12:29:29.110824+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:29.110824+0000","last_undegraded":"2024-05-09T12:29:29.110824+0000","last_fullsized":"2024-05-09T12:29:29.110824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:49:35.092328+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":2.1100265089999999,"stat_sum":{"num_bytes":6604,"num_objects":421,"num_object_clones":209,"num_object_copies":842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2f","version":"34'2570","reported_seq":2103,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.918479+0000","last_change":"2024-05-09T12:29:25.988454+0000","last_active":"2024-05-09T12:29:28.918479+0000","last_peered":"2024-05-09T12:29:28.918479+0000","last_clean":"2024-05-09T12:29:28.918479+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:28.918479+0000","last_undegraded":"2024-05-09T12:29:28.918479+0000","last_fullsized":"2024-05-09T12:29:28.918479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2570,"log_dups_size":0,"ondisk_log_size":2570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:06.956660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2005054039999998,"stat_sum":{"num_bytes":5699,"num_objects":763,"num_object_clones":497,"num_object_copies":1526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":265,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"34'1960","reported_seq":1628,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.849351+0000","last_change":"2024-05-09T12:29:25.992775+0000","last_active":"2024-05-09T12:29:28.849351+0000","last_peered":"2024-05-09T12:29:28.849351+0000","last_clean":"2024-05-09T12:29:28.849351+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:28.849351+0000","last_undegraded":"2024-05-09T12:29:28.849351+0000","last_fullsized":"2024-05-09T12:29:28.849351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":1960,"log_dups_size":0,"ondisk_log_size":1960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:13:30.515742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.407732142,"stat_sum":{"num_bytes":4309,"num_objects":577,"num_object_clones":375,"num_object_copies":1154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":577,"num_whiteouts":200,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2539","reported_seq":2114,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.535132+0000","last_change":"2024-05-09T12:29:29.264575+0000","last_active":"2024-05-09T12:29:29.535132+0000","last_peered":"2024-05-09T12:29:29.535132+0000","last_clean":"2024-05-09T12:29:29.535132+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:29.535132+0000","last_undegraded":"2024-05-09T12:29:29.535132+0000","last_fullsized":"2024-05-09T12:29:29.535132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2539,"log_dups_size":0,"ondisk_log_size":2539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":60,"snaptrim_duration":3.2011629560000001,"stat_sum":{"num_bytes":8405,"num_objects":599,"num_object_clones":373,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":223,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'2443","reported_seq":2018,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.947570+0000","last_change":"2024-05-09T12:29:25.992318+0000","last_active":"2024-05-09T12:29:28.947570+0000","last_peered":"2024-05-09T12:29:28.947570+0000","last_clean":"2024-05-09T12:29:28.947570+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:28.947570+0000","last_undegraded":"2024-05-09T12:29:28.947570+0000","last_fullsized":"2024-05-09T12:29:28.947570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2443,"log_dups_size":0,"ondisk_log_size":2443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.3989336090000002,"stat_sum":{"num_bytes":13345,"num_objects":686,"num_object_clones":449,"num_object_copies":1372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":686,"num_whiteouts":235,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2396","reported_seq":2020,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.953420+0000","last_change":"2024-05-09T12:29:25.990909+0000","last_active":"2024-05-09T12:29:28.953420+0000","last_peered":"2024-05-09T12:29:28.953420+0000","last_clean":"2024-05-09T12:29:28.953420+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:29:28.953420+0000","last_undegraded":"2024-05-09T12:29:28.953420+0000","last_fullsized":"2024-05-09T12:29:28.953420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2396,"log_dups_size":0,"ondisk_log_size":2396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6803539450000002,"stat_sum":{"num_bytes":4802,"num_objects":648,"num_object_clones":420,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":648,"num_whiteouts":227,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"34'3014","reported_seq":2427,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.958563+0000","last_change":"2024-05-09T12:29:27.145173+0000","last_active":"2024-05-09T12:29:28.958563+0000","last_peered":"2024-05-09T12:29:28.958563+0000","last_clean":"2024-05-09T12:29:28.958563+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:28.958563+0000","last_undegraded":"2024-05-09T12:29:28.958563+0000","last_fullsized":"2024-05-09T12:29:28.958563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":27,"snaptrim_duration":0.14221557100000001,"stat_sum":{"num_bytes":6852,"num_objects":459,"num_object_clones":228,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":228,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.29","version":"34'2770","reported_seq":2284,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.972393+0000","last_change":"2024-05-09T12:29:26.822981+0000","last_active":"2024-05-09T12:29:28.972393+0000","last_peered":"2024-05-09T12:29:28.972393+0000","last_clean":"2024-05-09T12:29:28.972393+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:29:28.972393+0000","last_undegraded":"2024-05-09T12:29:28.972393+0000","last_fullsized":"2024-05-09T12:29:28.972393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:33:55.785696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.83230441099999997,"stat_sum":{"num_bytes":2352,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.28","version":"34'2994","reported_seq":2423,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.300844+0000","last_change":"2024-05-09T12:29:29.300886+0000","last_active":"2024-05-09T12:29:29.300844+0000","last_peered":"2024-05-09T12:29:29.300844+0000","last_clean":"2024-05-09T12:29:29.300844+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:29.300844+0000","last_undegraded":"2024-05-09T12:29:29.300844+0000","last_fullsized":"2024-05-09T12:29:29.300844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:42.345451+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":2.299868375,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.27","version":"34'2578","reported_seq":2106,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.966126+0000","last_change":"2024-05-09T12:29:28.747416+0000","last_active":"2024-05-09T12:29:28.966126+0000","last_peered":"2024-05-09T12:29:28.966126+0000","last_clean":"2024-05-09T12:29:28.966126+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:28.966126+0000","last_undegraded":"2024-05-09T12:29:28.966126+0000","last_fullsized":"2024-05-09T12:29:28.966126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2578,"log_dups_size":0,"ondisk_log_size":2578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":209,"snaptrim_duration":1.7251567159999999,"stat_sum":{"num_bytes":2184,"num_objects":365,"num_object_clones":182,"num_object_copies":730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":182,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.26","version":"34'2618","reported_seq":2164,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.852413+0000","last_change":"2024-05-09T12:29:25.991543+0000","last_active":"2024-05-09T12:29:28.852413+0000","last_peered":"2024-05-09T12:29:28.852413+0000","last_clean":"2024-05-09T12:29:28.852413+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:28.852413+0000","last_undegraded":"2024-05-09T12:29:28.852413+0000","last_fullsized":"2024-05-09T12:29:28.852413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2618,"log_dups_size":0,"ondisk_log_size":2618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:43:39.979039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7098992329999998,"stat_sum":{"num_bytes":4943,"num_objects":660,"num_object_clones":431,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":660,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"34'2281","reported_seq":1870,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.929328+0000","last_change":"2024-05-09T12:29:25.993598+0000","last_active":"2024-05-09T12:29:28.929328+0000","last_peered":"2024-05-09T12:29:28.929328+0000","last_clean":"2024-05-09T12:29:28.929328+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:29:28.929328+0000","last_undegraded":"2024-05-09T12:29:28.929328+0000","last_fullsized":"2024-05-09T12:29:28.929328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4051381200000002,"stat_sum":{"num_bytes":4906,"num_objects":658,"num_object_clones":428,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":658,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2398","reported_seq":1963,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.542823+0000","last_change":"2024-05-09T12:29:28.820354+0000","last_active":"2024-05-09T12:29:29.542823+0000","last_peered":"2024-05-09T12:29:29.542823+0000","last_clean":"2024-05-09T12:29:29.542823+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:29:29.542823+0000","last_undegraded":"2024-05-09T12:29:29.542823+0000","last_fullsized":"2024-05-09T12:29:29.542823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:23.747102+0000","scrub_duration":0,"objects_trimmed":148,"snaptrim_duration":2.7095070670000001,"stat_sum":{"num_bytes":3377,"num_objects":497,"num_object_clones":289,"num_object_copies":994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":207,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"34'2589","reported_seq":2118,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.532891+0000","last_change":"2024-05-09T12:29:29.341013+0000","last_active":"2024-05-09T12:29:29.532891+0000","last_peered":"2024-05-09T12:29:29.532891+0000","last_clean":"2024-05-09T12:29:29.532891+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:29:29.532891+0000","last_undegraded":"2024-05-09T12:29:29.532891+0000","last_fullsized":"2024-05-09T12:29:29.532891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2589,"log_dups_size":0,"ondisk_log_size":2589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":68,"snaptrim_duration":3.1988044549999999,"stat_sum":{"num_bytes":4692,"num_objects":649,"num_object_clones":405,"num_object_copies":1298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":649,"num_whiteouts":242,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'2267","reported_seq":1888,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.894195+0000","last_change":"2024-05-09T12:29:25.992364+0000","last_active":"2024-05-09T12:29:28.894195+0000","last_peered":"2024-05-09T12:29:28.894195+0000","last_clean":"2024-05-09T12:29:28.894195+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:28.894195+0000","last_undegraded":"2024-05-09T12:29:28.894195+0000","last_fullsized":"2024-05-09T12:29:28.894195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2267,"log_dups_size":0,"ondisk_log_size":2267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4073458699999999,"stat_sum":{"num_bytes":4461,"num_objects":595,"num_object_clones":388,"num_object_copies":1190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":595,"num_whiteouts":205,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"34'3147","reported_seq":2529,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.938013+0000","last_change":"2024-05-09T12:29:28.820322+0000","last_active":"2024-05-09T12:29:28.938013+0000","last_peered":"2024-05-09T12:29:28.938013+0000","last_clean":"2024-05-09T12:29:28.938013+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:28.938013+0000","last_undegraded":"2024-05-09T12:29:28.938013+0000","last_fullsized":"2024-05-09T12:29:28.938013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3147,"log_dups_size":0,"ondisk_log_size":3147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:16.312292+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":1.808559872,"stat_sum":{"num_bytes":2856,"num_objects":477,"num_object_clones":238,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.20","version":"34'2733","reported_seq":2281,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.940396+0000","last_change":"2024-05-09T12:29:25.990846+0000","last_active":"2024-05-09T12:29:28.940396+0000","last_peered":"2024-05-09T12:29:28.940396+0000","last_clean":"2024-05-09T12:29:28.940396+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:28.940396+0000","last_undegraded":"2024-05-09T12:29:28.940396+0000","last_fullsized":"2024-05-09T12:29:28.940396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2733,"log_dups_size":0,"ondisk_log_size":2733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:14:49.401316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6800205699999999,"stat_sum":{"num_bytes":9578,"num_objects":734,"num_object_clones":478,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":254,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"34'2405","reported_seq":1973,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.961831+0000","last_change":"2024-05-09T12:29:25.991684+0000","last_active":"2024-05-09T12:29:28.961831+0000","last_peered":"2024-05-09T12:29:28.961831+0000","last_clean":"2024-05-09T12:29:28.961831+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:29:28.961831+0000","last_undegraded":"2024-05-09T12:29:28.961831+0000","last_fullsized":"2024-05-09T12:29:28.961831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:55.441325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7266697949999998,"stat_sum":{"num_bytes":13583,"num_objects":721,"num_object_clones":470,"num_object_copies":1442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":721,"num_whiteouts":249,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"32'4093","reported_seq":4144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000651+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:29:27.000651+0000","last_peered":"2024-05-09T12:29:27.000651+0000","last_clean":"2024-05-09T12:29:27.000651+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:27.000651+0000","last_undegraded":"2024-05-09T12:29:27.000651+0000","last_fullsized":"2024-05-09T12:29:27.000651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4093,"log_dups_size":0,"ondisk_log_size":4093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'2380","reported_seq":1964,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.902525+0000","last_change":"2024-05-09T12:29:25.994380+0000","last_active":"2024-05-09T12:29:28.902525+0000","last_peered":"2024-05-09T12:29:28.902525+0000","last_clean":"2024-05-09T12:29:28.902525+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:29:28.902525+0000","last_undegraded":"2024-05-09T12:29:28.902525+0000","last_fullsized":"2024-05-09T12:29:28.902525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.405652608,"stat_sum":{"num_bytes":5068,"num_objects":680,"num_object_clones":442,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":236,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003861+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:29:27.003861+0000","last_peered":"2024-05-09T12:29:27.003861+0000","last_clean":"2024-05-09T12:29:27.003861+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:27.003861+0000","last_undegraded":"2024-05-09T12:29:27.003861+0000","last_fullsized":"2024-05-09T12:29:27.003861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2605","reported_seq":2199,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962604+0000","last_change":"2024-05-09T12:29:25.989431+0000","last_active":"2024-05-09T12:29:28.962604+0000","last_peered":"2024-05-09T12:29:28.962604+0000","last_clean":"2024-05-09T12:29:28.962604+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:28.962604+0000","last_undegraded":"2024-05-09T12:29:28.962604+0000","last_fullsized":"2024-05-09T12:29:28.962604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:15:02.661928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2388007870000002,"stat_sum":{"num_bytes":4929,"num_objects":663,"num_object_clones":430,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":231,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"32'623","reported_seq":674,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000613+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:29:27.000613+0000","last_peered":"2024-05-09T12:29:27.000613+0000","last_clean":"2024-05-09T12:29:27.000613+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:27.000613+0000","last_undegraded":"2024-05-09T12:29:27.000613+0000","last_fullsized":"2024-05-09T12:29:27.000613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"34'2380","reported_seq":1960,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.940290+0000","last_change":"2024-05-09T12:29:25.988602+0000","last_active":"2024-05-09T12:29:28.940290+0000","last_peered":"2024-05-09T12:29:28.940290+0000","last_clean":"2024-05-09T12:29:28.940290+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:28.940290+0000","last_undegraded":"2024-05-09T12:29:28.940290+0000","last_fullsized":"2024-05-09T12:29:28.940290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:03:31.592242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2008599869999999,"stat_sum":{"num_bytes":9258,"num_objects":689,"num_object_clones":450,"num_object_copies":1378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":689,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'57","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001159+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:29:27.001159+0000","last_peered":"2024-05-09T12:29:27.001159+0000","last_clean":"2024-05-09T12:29:27.001159+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:29:27.001159+0000","last_undegraded":"2024-05-09T12:29:27.001159+0000","last_fullsized":"2024-05-09T12:29:27.001159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1484","reported_seq":1536,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999804+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:29:26.999804+0000","last_peered":"2024-05-09T12:29:26.999804+0000","last_clean":"2024-05-09T12:29:26.999804+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:26.999804+0000","last_undegraded":"2024-05-09T12:29:26.999804+0000","last_fullsized":"2024-05-09T12:29:26.999804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'2567","reported_seq":2096,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.503306+0000","last_change":"2024-05-09T12:29:29.110886+0000","last_active":"2024-05-09T12:29:29.503306+0000","last_peered":"2024-05-09T12:29:29.503306+0000","last_clean":"2024-05-09T12:29:29.503306+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:29.503306+0000","last_undegraded":"2024-05-09T12:29:29.503306+0000","last_fullsized":"2024-05-09T12:29:29.503306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2567,"log_dups_size":0,"ondisk_log_size":2567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:56.169314+0000","scrub_duration":0,"objects_trimmed":116,"snaptrim_duration":3.4035194949999998,"stat_sum":{"num_bytes":12106,"num_objects":567,"num_object_clones":337,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":567,"num_whiteouts":226,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"32'2803","reported_seq":2855,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000131+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:29:27.000131+0000","last_peered":"2024-05-09T12:29:27.000131+0000","last_clean":"2024-05-09T12:29:27.000131+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:27.000131+0000","last_undegraded":"2024-05-09T12:29:27.000131+0000","last_fullsized":"2024-05-09T12:29:27.000131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2649","reported_seq":2179,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:29.493664+0000","last_change":"2024-05-09T12:29:29.065844+0000","last_active":"2024-05-09T12:29:29.493664+0000","last_peered":"2024-05-09T12:29:29.493664+0000","last_clean":"2024-05-09T12:29:29.493664+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:29:29.493664+0000","last_undegraded":"2024-05-09T12:29:29.493664+0000","last_fullsized":"2024-05-09T12:29:29.493664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2649,"log_dups_size":0,"ondisk_log_size":2649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:05:54.659791+0000","scrub_duration":0,"objects_trimmed":93,"snaptrim_duration":3.6835376520000001,"stat_sum":{"num_bytes":4097,"num_objects":578,"num_object_clones":354,"num_object_copies":1156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":222,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6794","reported_seq":6846,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000422+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:29:27.000422+0000","last_peered":"2024-05-09T12:29:27.000422+0000","last_clean":"2024-05-09T12:29:27.000422+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:27.000422+0000","last_undegraded":"2024-05-09T12:29:27.000422+0000","last_fullsized":"2024-05-09T12:29:27.000422+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"34'2371","reported_seq":1946,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950951+0000","last_change":"2024-05-09T12:29:25.991223+0000","last_active":"2024-05-09T12:29:28.950951+0000","last_peered":"2024-05-09T12:29:28.950951+0000","last_clean":"2024-05-09T12:29:28.950951+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:28.950951+0000","last_undegraded":"2024-05-09T12:29:28.950951+0000","last_fullsized":"2024-05-09T12:29:28.950951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2371,"log_dups_size":0,"ondisk_log_size":2371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:51:39.325653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6839323959999999,"stat_sum":{"num_bytes":9192,"num_objects":678,"num_object_clones":444,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":678,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'1921","reported_seq":1973,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000094+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:29:27.000094+0000","last_peered":"2024-05-09T12:29:27.000094+0000","last_clean":"2024-05-09T12:29:27.000094+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:29:27.000094+0000","last_undegraded":"2024-05-09T12:29:27.000094+0000","last_fullsized":"2024-05-09T12:29:27.000094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"34'2243","reported_seq":1856,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.934780+0000","last_change":"2024-05-09T12:29:25.988500+0000","last_active":"2024-05-09T12:29:28.934780+0000","last_peered":"2024-05-09T12:29:28.934780+0000","last_clean":"2024-05-09T12:29:28.934780+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:29:28.934780+0000","last_undegraded":"2024-05-09T12:29:28.934780+0000","last_fullsized":"2024-05-09T12:29:28.934780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2243,"log_dups_size":0,"ondisk_log_size":2243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1994497970000002,"stat_sum":{"num_bytes":4725,"num_objects":625,"num_object_clones":410,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":214,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'4536","reported_seq":4588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010258+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:29:27.010258+0000","last_peered":"2024-05-09T12:29:27.010258+0000","last_clean":"2024-05-09T12:29:27.010258+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:27.010258+0000","last_undegraded":"2024-05-09T12:29:27.010258+0000","last_fullsized":"2024-05-09T12:29:27.010258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'2391","reported_seq":1940,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.963131+0000","last_change":"2024-05-09T12:29:25.992545+0000","last_active":"2024-05-09T12:29:28.963131+0000","last_peered":"2024-05-09T12:29:28.963131+0000","last_clean":"2024-05-09T12:29:28.963131+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:29:28.963131+0000","last_undegraded":"2024-05-09T12:29:28.963131+0000","last_fullsized":"2024-05-09T12:29:28.963131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2391,"log_dups_size":0,"ondisk_log_size":2391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4012607409999998,"stat_sum":{"num_bytes":13468,"num_objects":708,"num_object_clones":461,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":708,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'3404","reported_seq":3456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999488+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:29:26.999488+0000","last_peered":"2024-05-09T12:29:26.999488+0000","last_clean":"2024-05-09T12:29:26.999488+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:26.999488+0000","last_undegraded":"2024-05-09T12:29:26.999488+0000","last_fullsized":"2024-05-09T12:29:26.999488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2343","reported_seq":1936,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.922223+0000","last_change":"2024-05-09T12:29:25.993666+0000","last_active":"2024-05-09T12:29:28.922223+0000","last_peered":"2024-05-09T12:29:28.922223+0000","last_clean":"2024-05-09T12:29:28.922223+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:29:28.922223+0000","last_undegraded":"2024-05-09T12:29:28.922223+0000","last_fullsized":"2024-05-09T12:29:28.922223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4051755410000002,"stat_sum":{"num_bytes":5205,"num_objects":697,"num_object_clones":454,"num_object_copies":1394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":697,"num_whiteouts":243,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'1855","reported_seq":1907,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000832+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:29:27.000832+0000","last_peered":"2024-05-09T12:29:27.000832+0000","last_clean":"2024-05-09T12:29:27.000832+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:29:27.000832+0000","last_undegraded":"2024-05-09T12:29:27.000832+0000","last_fullsized":"2024-05-09T12:29:27.000832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"34'2913","reported_seq":2343,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950614+0000","last_change":"2024-05-09T12:29:28.402161+0000","last_active":"2024-05-09T12:29:28.950614+0000","last_peered":"2024-05-09T12:29:28.950614+0000","last_clean":"2024-05-09T12:29:28.950614+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:28.950614+0000","last_undegraded":"2024-05-09T12:29:28.950614+0000","last_fullsized":"2024-05-09T12:29:28.950614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:39:08.777335+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":1.402172266,"stat_sum":{"num_bytes":6772,"num_objects":449,"num_object_clones":223,"num_object_copies":898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":223,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.8","version":"32'178","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021383+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:29:27.021383+0000","last_peered":"2024-05-09T12:29:27.021383+0000","last_clean":"2024-05-09T12:29:27.021383+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:27.021383+0000","last_undegraded":"2024-05-09T12:29:27.021383+0000","last_fullsized":"2024-05-09T12:29:27.021383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'2328","reported_seq":1918,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.930560+0000","last_change":"2024-05-09T12:29:25.991553+0000","last_active":"2024-05-09T12:29:28.930560+0000","last_peered":"2024-05-09T12:29:28.930560+0000","last_clean":"2024-05-09T12:29:28.930560+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:28.930560+0000","last_undegraded":"2024-05-09T12:29:28.930560+0000","last_fullsized":"2024-05-09T12:29:28.930560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2328,"log_dups_size":0,"ondisk_log_size":2328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7121916960000001,"stat_sum":{"num_bytes":9296,"num_objects":693,"num_object_clones":452,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":693,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001317+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:29:27.001317+0000","last_peered":"2024-05-09T12:29:27.001317+0000","last_clean":"2024-05-09T12:29:27.001317+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:27.001317+0000","last_undegraded":"2024-05-09T12:29:27.001317+0000","last_fullsized":"2024-05-09T12:29:27.001317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'4944","reported_seq":4996,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.014781+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:29:27.014781+0000","last_peered":"2024-05-09T12:29:27.014781+0000","last_clean":"2024-05-09T12:29:27.014781+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:27.014781+0000","last_undegraded":"2024-05-09T12:29:27.014781+0000","last_fullsized":"2024-05-09T12:29:27.014781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4944,"log_dups_size":0,"ondisk_log_size":4944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2366","reported_seq":1962,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.936244+0000","last_change":"2024-05-09T12:29:25.994046+0000","last_active":"2024-05-09T12:29:28.936244+0000","last_peered":"2024-05-09T12:29:28.936244+0000","last_clean":"2024-05-09T12:29:28.936244+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:29:28.936244+0000","last_undegraded":"2024-05-09T12:29:28.936244+0000","last_fullsized":"2024-05-09T12:29:28.936244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.684844134,"stat_sum":{"num_bytes":4883,"num_objects":655,"num_object_clones":426,"num_object_copies":1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":655,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000924+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:29:27.000924+0000","last_peered":"2024-05-09T12:29:27.000924+0000","last_clean":"2024-05-09T12:29:27.000924+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:27.000924+0000","last_undegraded":"2024-05-09T12:29:27.000924+0000","last_fullsized":"2024-05-09T12:29:27.000924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'1013","reported_seq":1065,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999404+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:29:26.999404+0000","last_peered":"2024-05-09T12:29:26.999404+0000","last_clean":"2024-05-09T12:29:26.999404+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:26.999404+0000","last_undegraded":"2024-05-09T12:29:26.999404+0000","last_fullsized":"2024-05-09T12:29:26.999404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'2303","reported_seq":1888,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.976812+0000","last_change":"2024-05-09T12:29:25.991880+0000","last_active":"2024-05-09T12:29:28.976812+0000","last_peered":"2024-05-09T12:29:28.976812+0000","last_clean":"2024-05-09T12:29:28.976812+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:28.976812+0000","last_undegraded":"2024-05-09T12:29:28.976812+0000","last_fullsized":"2024-05-09T12:29:28.976812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:04.684532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7116899490000002,"stat_sum":{"num_bytes":5036,"num_objects":671,"num_object_clones":439,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999376+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:29:26.999376+0000","last_peered":"2024-05-09T12:29:26.999376+0000","last_clean":"2024-05-09T12:29:26.999376+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:26.999376+0000","last_undegraded":"2024-05-09T12:29:26.999376+0000","last_fullsized":"2024-05-09T12:29:26.999376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4164","reported_seq":4216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021467+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:29:27.021467+0000","last_peered":"2024-05-09T12:29:27.021467+0000","last_clean":"2024-05-09T12:29:27.021467+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:27.021467+0000","last_undegraded":"2024-05-09T12:29:27.021467+0000","last_fullsized":"2024-05-09T12:29:27.021467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2228","reported_seq":1844,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.940794+0000","last_change":"2024-05-09T12:29:25.992470+0000","last_active":"2024-05-09T12:29:28.940794+0000","last_peered":"2024-05-09T12:29:28.940794+0000","last_clean":"2024-05-09T12:29:28.940794+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:28.940794+0000","last_undegraded":"2024-05-09T12:29:28.940794+0000","last_fullsized":"2024-05-09T12:29:28.940794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2228,"log_dups_size":0,"ondisk_log_size":2228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7116334420000001,"stat_sum":{"num_bytes":9200,"num_objects":685,"num_object_clones":445,"num_object_copies":1370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":685,"num_whiteouts":236,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010407+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:29:27.010407+0000","last_peered":"2024-05-09T12:29:27.010407+0000","last_clean":"2024-05-09T12:29:27.010407+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:27.010407+0000","last_undegraded":"2024-05-09T12:29:27.010407+0000","last_fullsized":"2024-05-09T12:29:27.010407+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001224+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:29:27.001224+0000","last_peered":"2024-05-09T12:29:27.001224+0000","last_clean":"2024-05-09T12:29:27.001224+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:27.001224+0000","last_undegraded":"2024-05-09T12:29:27.001224+0000","last_fullsized":"2024-05-09T12:29:27.001224+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2644","reported_seq":2822,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.905869+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:29:27.905869+0000","last_peered":"2024-05-09T12:29:27.905869+0000","last_clean":"2024-05-09T12:29:27.905869+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:27.905869+0000","last_undegraded":"2024-05-09T12:29:27.905869+0000","last_fullsized":"2024-05-09T12:29:27.905869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2644,"log_dups_size":0,"ondisk_log_size":2644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"34'2398","reported_seq":1993,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.870020+0000","last_change":"2024-05-09T12:29:25.989124+0000","last_active":"2024-05-09T12:29:28.870020+0000","last_peered":"2024-05-09T12:29:28.870020+0000","last_clean":"2024-05-09T12:29:28.870020+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:28.870020+0000","last_undegraded":"2024-05-09T12:29:28.870020+0000","last_fullsized":"2024-05-09T12:29:28.870020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:54:43.130867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2019512539999999,"stat_sum":{"num_bytes":8824,"num_objects":633,"num_object_clones":413,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"34'1372","reported_seq":1424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:28.564512+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:29:28.564512+0000","last_peered":"2024-05-09T12:29:28.564512+0000","last_clean":"2024-05-09T12:29:28.564512+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:28.564512+0000","last_undegraded":"2024-05-09T12:29:28.564512+0000","last_fullsized":"2024-05-09T12:29:28.564512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1372,"log_dups_size":0,"ondisk_log_size":1372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340393,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1941,"num_write_kb":14182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016246+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:29:27.016246+0000","last_peered":"2024-05-09T12:29:27.016246+0000","last_clean":"2024-05-09T12:29:27.016246+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:27.016246+0000","last_undegraded":"2024-05-09T12:29:27.016246+0000","last_fullsized":"2024-05-09T12:29:27.016246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2199","reported_seq":1790,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.925987+0000","last_change":"2024-05-09T12:29:25.990624+0000","last_active":"2024-05-09T12:29:28.925987+0000","last_peered":"2024-05-09T12:29:28.925987+0000","last_clean":"2024-05-09T12:29:28.925987+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:28.925987+0000","last_undegraded":"2024-05-09T12:29:28.925987+0000","last_fullsized":"2024-05-09T12:29:28.925987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:09:19.316126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6840099820000001,"stat_sum":{"num_bytes":13134,"num_objects":665,"num_object_clones":432,"num_object_copies":1330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":665,"num_whiteouts":231,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'26","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.023253+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:29:27.023253+0000","last_peered":"2024-05-09T12:29:27.023253+0000","last_clean":"2024-05-09T12:29:27.023253+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:27.023253+0000","last_undegraded":"2024-05-09T12:29:27.023253+0000","last_fullsized":"2024-05-09T12:29:27.023253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001252+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:29:27.001252+0000","last_peered":"2024-05-09T12:29:27.001252+0000","last_clean":"2024-05-09T12:29:27.001252+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:27.001252+0000","last_undegraded":"2024-05-09T12:29:27.001252+0000","last_fullsized":"2024-05-09T12:29:27.001252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"34'2870","reported_seq":2290,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.975383+0000","last_change":"2024-05-09T12:29:27.522866+0000","last_active":"2024-05-09T12:29:28.975383+0000","last_peered":"2024-05-09T12:29:28.975383+0000","last_clean":"2024-05-09T12:29:28.975383+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:28.975383+0000","last_undegraded":"2024-05-09T12:29:28.975383+0000","last_fullsized":"2024-05-09T12:29:28.975383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":0.51712139599999996,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.4","version":"32'27","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016161+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:29:27.016161+0000","last_peered":"2024-05-09T12:29:27.016161+0000","last_clean":"2024-05-09T12:29:27.016161+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:27.016161+0000","last_undegraded":"2024-05-09T12:29:27.016161+0000","last_fullsized":"2024-05-09T12:29:27.016161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001385+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:29:27.001385+0000","last_peered":"2024-05-09T12:29:27.001385+0000","last_clean":"2024-05-09T12:29:27.001385+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:27.001385+0000","last_undegraded":"2024-05-09T12:29:27.001385+0000","last_fullsized":"2024-05-09T12:29:27.001385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"34'2523","reported_seq":2098,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950632+0000","last_change":"2024-05-09T12:29:25.988684+0000","last_active":"2024-05-09T12:29:28.950632+0000","last_peered":"2024-05-09T12:29:28.950632+0000","last_clean":"2024-05-09T12:29:28.950632+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:28.950632+0000","last_undegraded":"2024-05-09T12:29:28.950632+0000","last_fullsized":"2024-05-09T12:29:28.950632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2523,"log_dups_size":0,"ondisk_log_size":2523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2020225899999999,"stat_sum":{"num_bytes":5407,"num_objects":731,"num_object_clones":472,"num_object_copies":1462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":731,"num_whiteouts":257,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'2124","reported_seq":2176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000878+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:29:27.000878+0000","last_peered":"2024-05-09T12:29:27.000878+0000","last_clean":"2024-05-09T12:29:27.000878+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:27.000878+0000","last_undegraded":"2024-05-09T12:29:27.000878+0000","last_fullsized":"2024-05-09T12:29:27.000878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999956+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:29:26.999956+0000","last_peered":"2024-05-09T12:29:26.999956+0000","last_clean":"2024-05-09T12:29:26.999956+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:26.999956+0000","last_undegraded":"2024-05-09T12:29:26.999956+0000","last_fullsized":"2024-05-09T12:29:26.999956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"34'2204","reported_seq":1831,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.930483+0000","last_change":"2024-05-09T12:29:25.991638+0000","last_active":"2024-05-09T12:29:28.930483+0000","last_peered":"2024-05-09T12:29:28.930483+0000","last_clean":"2024-05-09T12:29:28.930483+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:28.930483+0000","last_undegraded":"2024-05-09T12:29:28.930483+0000","last_fullsized":"2024-05-09T12:29:28.930483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2204,"log_dups_size":0,"ondisk_log_size":2204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:54:49.330336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7089197359999999,"stat_sum":{"num_bytes":13096,"num_objects":663,"num_object_clones":427,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2333","reported_seq":1898,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.940506+0000","last_change":"2024-05-09T12:29:25.991227+0000","last_active":"2024-05-09T12:29:28.940506+0000","last_peered":"2024-05-09T12:29:28.940506+0000","last_clean":"2024-05-09T12:29:28.940506+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:28.940506+0000","last_undegraded":"2024-05-09T12:29:28.940506+0000","last_fullsized":"2024-05-09T12:29:28.940506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2333,"log_dups_size":0,"ondisk_log_size":2333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:51.710645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6833262630000001,"stat_sum":{"num_bytes":5353,"num_objects":720,"num_object_clones":467,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":251,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5456","reported_seq":5507,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000046+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:29:27.000046+0000","last_peered":"2024-05-09T12:29:27.000046+0000","last_clean":"2024-05-09T12:29:27.000046+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:27.000046+0000","last_undegraded":"2024-05-09T12:29:27.000046+0000","last_fullsized":"2024-05-09T12:29:27.000046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5456,"log_dups_size":0,"ondisk_log_size":5456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'2300","reported_seq":1901,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.909025+0000","last_change":"2024-05-09T12:29:25.991533+0000","last_active":"2024-05-09T12:29:28.909025+0000","last_peered":"2024-05-09T12:29:28.909025+0000","last_clean":"2024-05-09T12:29:28.909025+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:28.909025+0000","last_undegraded":"2024-05-09T12:29:28.909025+0000","last_fullsized":"2024-05-09T12:29:28.909025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2300,"log_dups_size":0,"ondisk_log_size":2300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:18.991011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.7110883970000001,"stat_sum":{"num_bytes":4927,"num_objects":668,"num_object_clones":431,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":668,"num_whiteouts":234,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'3054","reported_seq":3105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000825+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:29:27.000825+0000","last_peered":"2024-05-09T12:29:27.000825+0000","last_clean":"2024-05-09T12:29:27.000825+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:27.000825+0000","last_undegraded":"2024-05-09T12:29:27.000825+0000","last_fullsized":"2024-05-09T12:29:27.000825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3054,"log_dups_size":0,"ondisk_log_size":3054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"32'3359","reported_seq":3410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000042+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:29:27.000042+0000","last_peered":"2024-05-09T12:29:27.000042+0000","last_clean":"2024-05-09T12:29:27.000042+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:27.000042+0000","last_undegraded":"2024-05-09T12:29:27.000042+0000","last_fullsized":"2024-05-09T12:29:27.000042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"34'2978","reported_seq":2389,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.264510+0000","last_change":"2024-05-09T12:29:29.264548+0000","last_active":"2024-05-09T12:29:29.264510+0000","last_peered":"2024-05-09T12:29:29.264510+0000","last_clean":"2024-05-09T12:29:29.264510+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:29.264510+0000","last_undegraded":"2024-05-09T12:29:29.264510+0000","last_fullsized":"2024-05-09T12:29:29.264510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2978,"log_dups_size":0,"ondisk_log_size":2978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":245,"snaptrim_duration":2.2554360889999998,"stat_sum":{"num_bytes":2677,"num_objects":431,"num_object_clones":215,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":213,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.17","version":"32'1016","reported_seq":1067,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003768+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:29:27.003768+0000","last_peered":"2024-05-09T12:29:27.003768+0000","last_clean":"2024-05-09T12:29:27.003768+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:27.003768+0000","last_undegraded":"2024-05-09T12:29:27.003768+0000","last_fullsized":"2024-05-09T12:29:27.003768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'2910","reported_seq":2363,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.897372+0000","last_change":"2024-05-09T12:29:27.229793+0000","last_active":"2024-05-09T12:29:28.897372+0000","last_peered":"2024-05-09T12:29:28.897372+0000","last_clean":"2024-05-09T12:29:28.897372+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:29:28.897372+0000","last_undegraded":"2024-05-09T12:29:28.897372+0000","last_fullsized":"2024-05-09T12:29:28.897372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2910,"log_dups_size":0,"ondisk_log_size":2910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":38,"snaptrim_duration":0.20858475700000001,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.1f","version":"34'2179","reported_seq":1822,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.970475+0000","last_change":"2024-05-09T12:29:25.992750+0000","last_active":"2024-05-09T12:29:28.970475+0000","last_peered":"2024-05-09T12:29:28.970475+0000","last_clean":"2024-05-09T12:29:28.970475+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:29:28.970475+0000","last_undegraded":"2024-05-09T12:29:28.970475+0000","last_fullsized":"2024-05-09T12:29:28.970475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4055497849999998,"stat_sum":{"num_bytes":4930,"num_objects":661,"num_object_clones":430,"num_object_copies":1322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":661,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2400","reported_seq":2451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021261+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:29:27.021261+0000","last_peered":"2024-05-09T12:29:27.021261+0000","last_clean":"2024-05-09T12:29:27.021261+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:27.021261+0000","last_undegraded":"2024-05-09T12:29:27.021261+0000","last_fullsized":"2024-05-09T12:29:27.021261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2298","reported_seq":1907,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.926515+0000","last_change":"2024-05-09T12:29:25.989450+0000","last_active":"2024-05-09T12:29:28.926515+0000","last_peered":"2024-05-09T12:29:28.926515+0000","last_clean":"2024-05-09T12:29:28.926515+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:28.926515+0000","last_undegraded":"2024-05-09T12:29:28.926515+0000","last_fullsized":"2024-05-09T12:29:28.926515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:30.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2003033439999999,"stat_sum":{"num_bytes":8818,"num_objects":636,"num_object_clones":412,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":222,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'762","reported_seq":813,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.011836+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:29:27.011836+0000","last_peered":"2024-05-09T12:29:27.011836+0000","last_clean":"2024-05-09T12:29:27.011836+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:27.011836+0000","last_undegraded":"2024-05-09T12:29:27.011836+0000","last_fullsized":"2024-05-09T12:29:27.011836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2299","reported_seq":1904,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.959879+0000","last_change":"2024-05-09T12:29:25.988120+0000","last_active":"2024-05-09T12:29:28.959879+0000","last_peered":"2024-05-09T12:29:28.959879+0000","last_clean":"2024-05-09T12:29:28.959879+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:28.959879+0000","last_undegraded":"2024-05-09T12:29:28.959879+0000","last_fullsized":"2024-05-09T12:29:28.959879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2299,"log_dups_size":0,"ondisk_log_size":2299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.201924821,"stat_sum":{"num_bytes":4943,"num_objects":661,"num_object_clones":431,"num_object_copies":1322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":661,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"32'6247","reported_seq":6298,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999456+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:29:26.999456+0000","last_peered":"2024-05-09T12:29:26.999456+0000","last_clean":"2024-05-09T12:29:26.999456+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:26.999456+0000","last_undegraded":"2024-05-09T12:29:26.999456+0000","last_fullsized":"2024-05-09T12:29:26.999456+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5947,"log_dups_size":0,"ondisk_log_size":5947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2576","reported_seq":2100,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.942793+0000","last_change":"2024-05-09T12:29:25.991676+0000","last_active":"2024-05-09T12:29:28.942793+0000","last_peered":"2024-05-09T12:29:28.942793+0000","last_clean":"2024-05-09T12:29:28.942793+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:28.942793+0000","last_undegraded":"2024-05-09T12:29:28.942793+0000","last_fullsized":"2024-05-09T12:29:28.942793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2576,"log_dups_size":0,"ondisk_log_size":2576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:17:38.392357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.712409085,"stat_sum":{"num_bytes":5850,"num_objects":781,"num_object_clones":510,"num_object_copies":1562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":781,"num_whiteouts":270,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3295","reported_seq":3346,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.007212+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:29:27.007212+0000","last_peered":"2024-05-09T12:29:27.007212+0000","last_clean":"2024-05-09T12:29:27.007212+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:27.007212+0000","last_undegraded":"2024-05-09T12:29:27.007212+0000","last_fullsized":"2024-05-09T12:29:27.007212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3295,"log_dups_size":0,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2209","reported_seq":1798,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.934292+0000","last_change":"2024-05-09T12:29:25.991522+0000","last_active":"2024-05-09T12:29:28.934292+0000","last_peered":"2024-05-09T12:29:28.934292+0000","last_clean":"2024-05-09T12:29:28.934292+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:28.934292+0000","last_undegraded":"2024-05-09T12:29:28.934292+0000","last_fullsized":"2024-05-09T12:29:28.934292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2209,"log_dups_size":0,"ondisk_log_size":2209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:45.377609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.681387118,"stat_sum":{"num_bytes":5393,"num_objects":717,"num_object_clones":470,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":247,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'626","reported_seq":677,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999266+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:29:26.999266+0000","last_peered":"2024-05-09T12:29:26.999266+0000","last_clean":"2024-05-09T12:29:26.999266+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:26.999266+0000","last_undegraded":"2024-05-09T12:29:26.999266+0000","last_fullsized":"2024-05-09T12:29:26.999266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2317","reported_seq":1891,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.897403+0000","last_change":"2024-05-09T12:29:25.991005+0000","last_active":"2024-05-09T12:29:28.897403+0000","last_peered":"2024-05-09T12:29:28.897403+0000","last_clean":"2024-05-09T12:29:28.897403+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:29:28.897403+0000","last_undegraded":"2024-05-09T12:29:28.897403+0000","last_fullsized":"2024-05-09T12:29:28.897403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6826947699999999,"stat_sum":{"num_bytes":5054,"num_objects":680,"num_object_clones":441,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'8181","reported_seq":8232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001864+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:29:27.001864+0000","last_peered":"2024-05-09T12:29:27.001864+0000","last_clean":"2024-05-09T12:29:27.001864+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:29:27.001864+0000","last_undegraded":"2024-05-09T12:29:27.001864+0000","last_fullsized":"2024-05-09T12:29:27.001864+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2250","reported_seq":1852,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.739081+0000","last_change":"2024-05-09T12:29:25.988251+0000","last_active":"2024-05-09T12:29:28.739081+0000","last_peered":"2024-05-09T12:29:28.739081+0000","last_clean":"2024-05-09T12:29:28.739081+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:28.739081+0000","last_undegraded":"2024-05-09T12:29:28.739081+0000","last_fullsized":"2024-05-09T12:29:28.739081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2250,"log_dups_size":0,"ondisk_log_size":2250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.19910534,"stat_sum":{"num_bytes":4727,"num_objects":630,"num_object_clones":412,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":630,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'5552","reported_seq":5604,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.002688+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:29:27.002688+0000","last_peered":"2024-05-09T12:29:27.002688+0000","last_clean":"2024-05-09T12:29:27.002688+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:27.002688+0000","last_undegraded":"2024-05-09T12:29:27.002688+0000","last_fullsized":"2024-05-09T12:29:27.002688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5552,"log_dups_size":0,"ondisk_log_size":5552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'2735","reported_seq":2217,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.919435+0000","last_change":"2024-05-09T12:29:25.991077+0000","last_active":"2024-05-09T12:29:28.919435+0000","last_peered":"2024-05-09T12:29:28.919435+0000","last_clean":"2024-05-09T12:29:28.919435+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:28.919435+0000","last_undegraded":"2024-05-09T12:29:28.919435+0000","last_fullsized":"2024-05-09T12:29:28.919435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:41:38.978431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.6830141830000001,"stat_sum":{"num_bytes":5998,"num_objects":803,"num_object_clones":523,"num_object_copies":1606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":803,"num_whiteouts":277,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2436","reported_seq":2488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003486+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:29:27.003486+0000","last_peered":"2024-05-09T12:29:27.003486+0000","last_clean":"2024-05-09T12:29:27.003486+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:27.003486+0000","last_undegraded":"2024-05-09T12:29:27.003486+0000","last_fullsized":"2024-05-09T12:29:27.003486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2436,"log_dups_size":0,"ondisk_log_size":2436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":402318,"num_objects":38502,"num_object_clones":23812,"num_object_copies":77004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38502,"num_whiteouts":14575,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":195239936,"data_stored":804332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161154,"ondisk_log_size":161154,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287126729,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87025,"num_write_kb":575462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574316544,"data_stored":574253458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82350,"ondisk_log_size":82350,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705778,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":766836,"kb_used_data":162284,"kb_used_omap":1,"kb_used_meta":604542,"kb_avail":93605004,"statfs":{"total":96636764160,"available":95851524096,"internally_reserved":0,"allocated":166178816,"data_stored":118381118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":619051463},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705778,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":949208,"kb_used_data":214148,"kb_used_omap":1,"kb_used_meta":735038,"kb_avail":93422632,"statfs":{"total":96636764160,"available":95664775168,"internally_reserved":0,"allocated":219287552,"data_stored":175451484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":752679365},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705780,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595456,"kb_used_data":167272,"kb_used_omap":1,"kb_used_meta":428158,"kb_avail":93776384,"statfs":{"total":96636764160,"available":96027017216,"internally_reserved":0,"allocated":171286528,"data_stored":108773388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":438434245},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705780,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":811476,"kb_used_data":216712,"kb_used_omap":1,"kb_used_meta":594750,"kb_avail":93560364,"statfs":{"total":96636764160,"available":95805812736,"internally_reserved":0,"allocated":221913088,"data_stored":174195555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":609024453},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,5,3,5,8,8,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173895680,"data_stored":173879793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107810816,"data_stored":107809385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47583232,"data_stored":179255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58630144,"data_stored":226495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41799680,"data_stored":187616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47226880,"data_stored":210966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:29:35.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:29:35.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.639+0000 7fd34372f640 1 Processor -- start 2024-05-09T12:29:35.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.639+0000 7fd34372f640 1 -- start start 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd34372f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd33c13d340 0x7fd33c1454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd34372f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c0a09a0 con 0x7fd33c13c850 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd34372f640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c09b980 con 0x7fd33c09b3d0 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd34372f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c09c2a0 con 0x7fd33c13d340 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd341ccc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd33c13d340 0x7fd33c1454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd341ccc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd33c13d340 0x7fd33c1454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37234/0 (socket says 172.21.15.135:37234) 2024-05-09T12:29:35.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.640+0000 7fd341ccc640 1 -- 172.21.15.135:0/1598215097 learned_addr learned my addr 172.21.15.135:0/1598215097 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:35.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.641+0000 7fd341ccc640 1 -- 172.21.15.135:0/1598215097 >> v1:172.21.15.160:6789/0 conn(0x7fd33c09b3d0 legacy=0x7fd33c141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.641+0000 7fd341ccc640 1 -- 172.21.15.135:0/1598215097 >> v1:172.21.15.135:6789/0 conn(0x7fd33c13c850 legacy=0x7fd33c13cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.641+0000 7fd341ccc640 1 -- 172.21.15.135:0/1598215097 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c09e670 con 0x7fd33c13d340 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.642+0000 7fd341ccc640 1 --2- 172.21.15.135:0/1598215097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13d340 0x7fd33c1454b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ac860 tx=0x7fd33402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1818f08d3a4e4bc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.642+0000 7fd333fff640 1 -- 172.21.15.135:0/1598215097 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33402c9b0 con 0x7fd33c13d340 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.642+0000 7fd333fff640 1 -- 172.21.15.135:0/1598215097 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33402cb50 con 0x7fd33c13d340 2024-05-09T12:29:35.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.642+0000 7fd333fff640 1 -- 172.21.15.135:0/1598215097 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3340343f0 con 0x7fd33c13d340 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.643+0000 7fd34372f640 1 -- 172.21.15.135:0/1598215097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13d340 msgr2=0x7fd33c1454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.643+0000 7fd34372f640 1 --2- 172.21.15.135:0/1598215097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13d340 0x7fd33c1454b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ac860 tx=0x7fd33402be10 comp rx=0 tx=0).stop 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.643+0000 7fd34372f640 1 -- 172.21.15.135:0/1598215097 shutdown_connections 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.643+0000 7fd34372f640 1 --2- 172.21.15.135:0/1598215097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13d340 0x7fd33c1454b0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.643+0000 7fd34372f640 1 -- 172.21.15.135:0/1598215097 >> 172.21.15.135:0/1598215097 conn(0x7fd33c075cf0 msgr2=0x7fd33c0aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.644+0000 7fd34372f640 1 -- 172.21.15.135:0/1598215097 shutdown_connections 2024-05-09T12:29:35.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.644+0000 7fd34372f640 1 -- 172.21.15.135:0/1598215097 wait complete. 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 Processor -- start 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 -- start start 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd33c09b3d0 0x7fd33c1390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd340cca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd340cca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37248/0 (socket says 172.21.15.135:37248) 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd340cca640 1 -- 172.21.15.135:0/1657898934 learned_addr learned my addr 172.21.15.135:0/1657898934 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd33c13d340 0x7fd33c1d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd3414cb640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd33c09b3d0 0x7fd33c1390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c09bc70 con 0x7fd33c13c850 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c09cdf0 con 0x7fd33c13d340 2024-05-09T12:29:35.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.645+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c09c9a0 con 0x7fd33c09b3d0 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd341ccc640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd33c13d340 0x7fd33c1d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 -- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd33c09b3d0 msgr2=0x7fd33c1390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd33c09b3d0 0x7fd33c1390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 -- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd33c13d340 msgr2=0x7fd33c1d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd33c13d340 0x7fd33c1d1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c0ac5f0 con 0x7fd33c13c850 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd340cca640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c430 tx=0x7fd32c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011790 con 0x7fd33c13c850 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c017070 con 0x7fd33c13c850 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c011bb0 con 0x7fd33c13c850 2024-05-09T12:29:35.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.646+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c13cc30 con 0x7fd33c13c850 2024-05-09T12:29:35.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.647+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c0abdc0 con 0x7fd33c13c850 2024-05-09T12:29:35.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.648+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33c0aad90 con 0x7fd33c13c850 2024-05-09T12:29:35.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.649+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd32c01c460 con 0x7fd33c13c850 2024-05-09T12:29:35.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.649+0000 7fd331ffb640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 0x7fd320078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:35.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.649+0000 7fd3414cb640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 0x7fd320078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:35.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.649+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fd32c096da0 con 0x7fd33c13c850 2024-05-09T12:29:35.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.650+0000 7fd3414cb640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 0x7fd320078890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0aa4d0 tx=0x7fd338009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:35.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.656+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd33c0aad90 con 0x7fd33c13c850 2024-05-09T12:29:35.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.950+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd33c139e80 con 0x7fd3200763d0 2024-05-09T12:29:35.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.960+0000 7fd331ffb640 1 -- 172.21.15.135:0/1657898934 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+274886 (secure 0 0 0) 0x7fd33c139e80 con 0x7fd3200763d0 2024-05-09T12:29:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:29:35.966 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:29:35.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.965+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 msgr2=0x7fd320078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.965+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 0x7fd320078890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0aa4d0 tx=0x7fd338009040 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.965+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 msgr2=0x7fd33c139620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00c430 tx=0x7fd32c00c8f0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 shutdown_connections 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd3200763d0 0x7fd320078890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd33c13d340 0x7fd33c1d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33c13c850 0x7fd33c139620 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 --2- 172.21.15.135:0/1657898934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd33c09b3d0 0x7fd33c1390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 >> 172.21.15.135:0/1657898934 conn(0x7fd33c075cf0 msgr2=0x7fd33c0acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 shutdown_connections 2024-05-09T12:29:35.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:35.966+0000 7fd34372f640 1 -- 172.21.15.135:0/1657898934 wait complete. 2024-05-09T12:29:35.984 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-05-09T12:29:35.485117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":288033791,"num_objects":29884,"num_object_clones":16028,"num_object_copies":59768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29884,"num_whiteouts":13622,"num_read":255,"num_read_kb":3256,"num_write":164634,"num_write_kb":617687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259144,"ondisk_log_size":259144,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3149224,"kb_used_data":696420,"kb_used_omap":6,"kb_used_meta":2452729,"kb_avail":374338136,"statfs":{"total":386547056640,"available":383322251264,"internally_reserved":0,"allocated":713134080,"data_stored":576625175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2511595286},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,5,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4890620,"num_objects":-13855,"num_object_clones":-12359,"num_object_copies":-27710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13855,"num_whiteouts":346,"num_read":3,"num_read_kb":184,"num_write":1879,"num_write_kb":4948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.499161"},"pg_stats":[{"pgid":"4.3f","version":"34'2278","reported_seq":1873,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.540169+0000","last_change":"2024-05-09T12:29:34.441134+0000","last_active":"2024-05-09T12:29:34.540169+0000","last_peered":"2024-05-09T12:29:34.540169+0000","last_clean":"2024-05-09T12:29:34.540169+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:29:34.540169+0000","last_undegraded":"2024-05-09T12:29:34.540169+0000","last_fullsized":"2024-05-09T12:29:34.540169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:08:18.309520+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":3.2013429659999999,"stat_sum":{"num_bytes":4436,"num_objects":600,"num_object_clones":386,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":600,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2813","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.865638+0000","last_change":"2024-05-09T12:29:27.421182+0000","last_active":"2024-05-09T12:29:28.865638+0000","last_peered":"2024-05-09T12:29:28.865638+0000","last_clean":"2024-05-09T12:29:28.865638+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:29:28.865638+0000","last_undegraded":"2024-05-09T12:29:28.865638+0000","last_fullsized":"2024-05-09T12:29:28.865638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2813,"log_dups_size":0,"ondisk_log_size":2813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:35:26.401558+0000","scrub_duration":0,"objects_trimmed":64,"snaptrim_duration":0.42135249400000002,"stat_sum":{"num_bytes":2304,"num_objects":384,"num_object_clones":192,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":384,"num_whiteouts":192,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3d","version":"34'2725","reported_seq":2266,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.509085+0000","last_change":"2024-05-09T12:29:33.642801+0000","last_active":"2024-05-09T12:29:34.509085+0000","last_peered":"2024-05-09T12:29:34.509085+0000","last_clean":"2024-05-09T12:29:34.509085+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:34.509085+0000","last_undegraded":"2024-05-09T12:29:34.509085+0000","last_fullsized":"2024-05-09T12:29:34.509085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2725,"log_dups_size":0,"ondisk_log_size":2725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":176,"snaptrim_duration":3.4094307000000001,"stat_sum":{"num_bytes":3268,"num_objects":489,"num_object_clones":280,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'3004","reported_seq":2413,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.065797+0000","last_change":"2024-05-09T12:29:29.065840+0000","last_active":"2024-05-09T12:29:29.065797+0000","last_peered":"2024-05-09T12:29:29.065797+0000","last_clean":"2024-05-09T12:29:29.065797+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:29:29.065797+0000","last_undegraded":"2024-05-09T12:29:29.065797+0000","last_fullsized":"2024-05-09T12:29:29.065797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3004,"log_dups_size":0,"ondisk_log_size":3004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":2.066871688,"stat_sum":{"num_bytes":6936,"num_objects":470,"num_object_clones":234,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3b","version":"34'2489","reported_seq":2071,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962721+0000","last_change":"2024-05-09T12:29:25.988863+0000","last_active":"2024-05-09T12:29:28.962721+0000","last_peered":"2024-05-09T12:29:28.962721+0000","last_clean":"2024-05-09T12:29:28.962721+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:28.962721+0000","last_undegraded":"2024-05-09T12:29:28.962721+0000","last_fullsized":"2024-05-09T12:29:28.962721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2489,"log_dups_size":0,"ondisk_log_size":2489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2016601869999999,"stat_sum":{"num_bytes":5152,"num_objects":692,"num_object_clones":448,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":243,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2913","reported_seq":2396,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.333388+0000","last_change":"2024-05-09T12:29:30.333427+0000","last_active":"2024-05-09T12:29:30.333388+0000","last_peered":"2024-05-09T12:29:30.333388+0000","last_clean":"2024-05-09T12:29:30.333388+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:30.333388+0000","last_undegraded":"2024-05-09T12:29:30.333388+0000","last_fullsized":"2024-05-09T12:29:30.333388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":3.3343178679999999,"stat_sum":{"num_bytes":2558,"num_objects":428,"num_object_clones":213,"num_object_copies":856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":213,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.39","version":"34'2840","reported_seq":2333,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950993+0000","last_change":"2024-05-09T12:29:27.270399+0000","last_active":"2024-05-09T12:29:28.950993+0000","last_peered":"2024-05-09T12:29:28.950993+0000","last_clean":"2024-05-09T12:29:28.950993+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:29:28.950993+0000","last_undegraded":"2024-05-09T12:29:28.950993+0000","last_fullsized":"2024-05-09T12:29:28.950993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":40,"snaptrim_duration":0.26985108400000002,"stat_sum":{"num_bytes":2448,"num_objects":411,"num_object_clones":204,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":411,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.38","version":"34'2735","reported_seq":2226,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.955573+0000","last_change":"2024-05-09T12:29:27.368044+0000","last_active":"2024-05-09T12:29:28.955573+0000","last_peered":"2024-05-09T12:29:28.955573+0000","last_clean":"2024-05-09T12:29:28.955573+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:28.955573+0000","last_undegraded":"2024-05-09T12:29:28.955573+0000","last_fullsized":"2024-05-09T12:29:28.955573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":56,"snaptrim_duration":0.36738837800000002,"stat_sum":{"num_bytes":6556,"num_objects":413,"num_object_clones":206,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.37","version":"34'2951","reported_seq":2415,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.704216+0000","last_change":"2024-05-09T12:29:32.704258+0000","last_active":"2024-05-09T12:29:32.704216+0000","last_peered":"2024-05-09T12:29:32.704216+0000","last_clean":"2024-05-09T12:29:32.704216+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:32.704216+0000","last_undegraded":"2024-05-09T12:29:32.704216+0000","last_fullsized":"2024-05-09T12:29:32.704216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2951,"log_dups_size":0,"ondisk_log_size":2951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":5.7016304350000002,"stat_sum":{"num_bytes":6579,"num_objects":416,"num_object_clones":206,"num_object_copies":832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.36","version":"34'2524","reported_seq":2067,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.385621+0000","last_change":"2024-05-09T12:29:32.385651+0000","last_active":"2024-05-09T12:29:32.385621+0000","last_peered":"2024-05-09T12:29:32.385621+0000","last_clean":"2024-05-09T12:29:32.385621+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:29:32.385621+0000","last_undegraded":"2024-05-09T12:29:32.385621+0000","last_fullsized":"2024-05-09T12:29:32.385621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2524,"log_dups_size":0,"ondisk_log_size":2524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:40.886862+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":5.3845229720000001,"stat_sum":{"num_bytes":6340,"num_objects":376,"num_object_clones":187,"num_object_copies":752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":376,"num_whiteouts":187,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.35","version":"34'2587","reported_seq":2113,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.939132+0000","last_change":"2024-05-09T12:29:27.177743+0000","last_active":"2024-05-09T12:29:28.939132+0000","last_peered":"2024-05-09T12:29:28.939132+0000","last_clean":"2024-05-09T12:29:28.939132+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:28.939132+0000","last_undegraded":"2024-05-09T12:29:28.939132+0000","last_fullsized":"2024-05-09T12:29:28.939132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2587,"log_dups_size":0,"ondisk_log_size":2587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:19:09.204008+0000","scrub_duration":0,"objects_trimmed":29,"snaptrim_duration":0.17742645300000001,"stat_sum":{"num_bytes":6436,"num_objects":394,"num_object_clones":195,"num_object_copies":788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":394,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.34","version":"34'2743","reported_seq":2207,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.147320+0000","last_change":"2024-05-09T12:29:30.147356+0000","last_active":"2024-05-09T12:29:30.147320+0000","last_peered":"2024-05-09T12:29:30.147320+0000","last_clean":"2024-05-09T12:29:30.147320+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:30.147320+0000","last_undegraded":"2024-05-09T12:29:30.147320+0000","last_fullsized":"2024-05-09T12:29:30.147320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2743,"log_dups_size":0,"ondisk_log_size":2743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:31.554547+0000","scrub_duration":0,"objects_trimmed":278,"snaptrim_duration":3.1348838529999998,"stat_sum":{"num_bytes":2616,"num_objects":442,"num_object_clones":220,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.33","version":"34'2859","reported_seq":2362,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.340953+0000","last_change":"2024-05-09T12:29:29.340994+0000","last_active":"2024-05-09T12:29:29.340953+0000","last_peered":"2024-05-09T12:29:29.340953+0000","last_clean":"2024-05-09T12:29:29.340953+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:29:29.340953+0000","last_undegraded":"2024-05-09T12:29:29.340953+0000","last_fullsized":"2024-05-09T12:29:29.340953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2859,"log_dups_size":0,"ondisk_log_size":2859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":2.3344210159999998,"stat_sum":{"num_bytes":6388,"num_objects":385,"num_object_clones":191,"num_object_copies":770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":191,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.32","version":"34'3072","reported_seq":2520,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.706144+0000","last_change":"2024-05-09T12:29:31.706192+0000","last_active":"2024-05-09T12:29:31.706144+0000","last_peered":"2024-05-09T12:29:31.706144+0000","last_clean":"2024-05-09T12:29:31.706144+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:31.706144+0000","last_undegraded":"2024-05-09T12:29:31.706144+0000","last_fullsized":"2024-05-09T12:29:31.706144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":285,"snaptrim_duration":4.7073636969999999,"stat_sum":{"num_bytes":2604,"num_objects":438,"num_object_clones":218,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":218,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.31","version":"34'2969","reported_seq":2431,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.994319+0000","last_change":"2024-05-09T12:29:29.994349+0000","last_active":"2024-05-09T12:29:29.994319+0000","last_peered":"2024-05-09T12:29:29.994319+0000","last_clean":"2024-05-09T12:29:29.994319+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:29:29.994319+0000","last_undegraded":"2024-05-09T12:29:29.994319+0000","last_fullsized":"2024-05-09T12:29:29.994319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:53.594808+0000","scrub_duration":0,"objects_trimmed":277,"snaptrim_duration":2.9934828869999999,"stat_sum":{"num_bytes":6640,"num_objects":427,"num_object_clones":213,"num_object_copies":854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.30","version":"34'2851","reported_seq":2318,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.110824+0000","last_change":"2024-05-09T12:29:29.110851+0000","last_active":"2024-05-09T12:29:29.110824+0000","last_peered":"2024-05-09T12:29:29.110824+0000","last_clean":"2024-05-09T12:29:29.110824+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:29.110824+0000","last_undegraded":"2024-05-09T12:29:29.110824+0000","last_fullsized":"2024-05-09T12:29:29.110824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:49:35.092328+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":2.1100265089999999,"stat_sum":{"num_bytes":6604,"num_objects":421,"num_object_clones":209,"num_object_copies":842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2f","version":"34'3100","reported_seq":2505,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.156770+0000","last_change":"2024-05-09T12:29:33.156806+0000","last_active":"2024-05-09T12:29:33.156770+0000","last_peered":"2024-05-09T12:29:33.156770+0000","last_clean":"2024-05-09T12:29:33.156770+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:33.156770+0000","last_undegraded":"2024-05-09T12:29:33.156770+0000","last_fullsized":"2024-05-09T12:29:33.156770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3100,"log_dups_size":0,"ondisk_log_size":3100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:06.956660+0000","scrub_duration":0,"objects_trimmed":298,"snaptrim_duration":6.1535401160000003,"stat_sum":{"num_bytes":2784,"num_objects":465,"num_object_clones":232,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2e","version":"34'2360","reported_seq":1932,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.642736+0000","last_change":"2024-05-09T12:29:33.642775+0000","last_active":"2024-05-09T12:29:33.642736+0000","last_peered":"2024-05-09T12:29:33.642736+0000","last_clean":"2024-05-09T12:29:33.642736+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:33.642736+0000","last_undegraded":"2024-05-09T12:29:33.642736+0000","last_fullsized":"2024-05-09T12:29:33.642736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2360,"log_dups_size":0,"ondisk_log_size":2360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:13:30.515742+0000","scrub_duration":0,"objects_trimmed":226,"snaptrim_duration":6.641452707,"stat_sum":{"num_bytes":2109,"num_objects":351,"num_object_clones":175,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":174,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2d","version":"34'2873","reported_seq":2367,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.349086+0000","last_change":"2024-05-09T12:29:30.349122+0000","last_active":"2024-05-09T12:29:30.349086+0000","last_peered":"2024-05-09T12:29:30.349086+0000","last_clean":"2024-05-09T12:29:30.349086+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:30.349086+0000","last_undegraded":"2024-05-09T12:29:30.349086+0000","last_fullsized":"2024-05-09T12:29:30.349086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2873,"log_dups_size":0,"ondisk_log_size":2873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.3445633849999998,"stat_sum":{"num_bytes":6568,"num_objects":415,"num_object_clones":206,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":206,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2c","version":"34'2913","reported_seq":2375,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.291751+0000","last_change":"2024-05-09T12:29:31.291779+0000","last_active":"2024-05-09T12:29:31.291751+0000","last_peered":"2024-05-09T12:29:31.291751+0000","last_clean":"2024-05-09T12:29:31.291751+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:31.291751+0000","last_undegraded":"2024-05-09T12:29:31.291751+0000","last_fullsized":"2024-05-09T12:29:31.291751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.2925059000000001,"stat_sum":{"num_bytes":10760,"num_objects":430,"num_object_clones":214,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2b","version":"34'2848","reported_seq":2363,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.834549+0000","last_change":"2024-05-09T12:29:32.834594+0000","last_active":"2024-05-09T12:29:32.834549+0000","last_peered":"2024-05-09T12:29:32.834549+0000","last_clean":"2024-05-09T12:29:32.834549+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:29:32.834549+0000","last_undegraded":"2024-05-09T12:29:32.834549+0000","last_fullsized":"2024-05-09T12:29:32.834549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":259,"snaptrim_duration":5.8356664780000003,"stat_sum":{"num_bytes":2316,"num_objects":389,"num_object_clones":194,"num_object_copies":778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":389,"num_whiteouts":194,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2a","version":"34'3014","reported_seq":2427,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.958563+0000","last_change":"2024-05-09T12:29:27.145173+0000","last_active":"2024-05-09T12:29:28.958563+0000","last_peered":"2024-05-09T12:29:28.958563+0000","last_clean":"2024-05-09T12:29:28.958563+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:28.958563+0000","last_undegraded":"2024-05-09T12:29:28.958563+0000","last_fullsized":"2024-05-09T12:29:28.958563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":27,"snaptrim_duration":0.14221557100000001,"stat_sum":{"num_bytes":6852,"num_objects":459,"num_object_clones":228,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":228,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.29","version":"34'2770","reported_seq":2284,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.972393+0000","last_change":"2024-05-09T12:29:26.822981+0000","last_active":"2024-05-09T12:29:28.972393+0000","last_peered":"2024-05-09T12:29:28.972393+0000","last_clean":"2024-05-09T12:29:28.972393+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:29:28.972393+0000","last_undegraded":"2024-05-09T12:29:28.972393+0000","last_fullsized":"2024-05-09T12:29:28.972393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:33:55.785696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.83230441099999997,"stat_sum":{"num_bytes":2352,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.28","version":"34'2994","reported_seq":2423,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.300844+0000","last_change":"2024-05-09T12:29:29.300886+0000","last_active":"2024-05-09T12:29:29.300844+0000","last_peered":"2024-05-09T12:29:29.300844+0000","last_clean":"2024-05-09T12:29:29.300844+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:29.300844+0000","last_undegraded":"2024-05-09T12:29:29.300844+0000","last_fullsized":"2024-05-09T12:29:29.300844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:42.345451+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":2.299868375,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.27","version":"34'2578","reported_seq":2106,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.966126+0000","last_change":"2024-05-09T12:29:28.747416+0000","last_active":"2024-05-09T12:29:28.966126+0000","last_peered":"2024-05-09T12:29:28.966126+0000","last_clean":"2024-05-09T12:29:28.966126+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:28.966126+0000","last_undegraded":"2024-05-09T12:29:28.966126+0000","last_fullsized":"2024-05-09T12:29:28.966126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2578,"log_dups_size":0,"ondisk_log_size":2578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":209,"snaptrim_duration":1.7251567159999999,"stat_sum":{"num_bytes":2184,"num_objects":365,"num_object_clones":182,"num_object_copies":730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":182,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.26","version":"34'3076","reported_seq":2512,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.179678+0000","last_change":"2024-05-09T12:29:31.179719+0000","last_active":"2024-05-09T12:29:31.179678+0000","last_peered":"2024-05-09T12:29:31.179678+0000","last_clean":"2024-05-09T12:29:31.179678+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:31.179678+0000","last_undegraded":"2024-05-09T12:29:31.179678+0000","last_fullsized":"2024-05-09T12:29:31.179678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3076,"log_dups_size":0,"ondisk_log_size":3076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:43:39.979039+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.1654695000000004,"stat_sum":{"num_bytes":2424,"num_objects":404,"num_object_clones":202,"num_object_copies":808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.25","version":"34'2457","reported_seq":2002,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.503769+0000","last_change":"2024-05-09T12:29:33.975582+0000","last_active":"2024-05-09T12:29:34.503769+0000","last_peered":"2024-05-09T12:29:34.503769+0000","last_clean":"2024-05-09T12:29:34.503769+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:29:34.503769+0000","last_undegraded":"2024-05-09T12:29:34.503769+0000","last_fullsized":"2024-05-09T12:29:34.503769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":103,"snaptrim_duration":3.4051381200000002,"stat_sum":{"num_bytes":3938,"num_objects":555,"num_object_clones":340,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2580","reported_seq":2102,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.973591+0000","last_change":"2024-05-09T12:29:29.973628+0000","last_active":"2024-05-09T12:29:29.973591+0000","last_peered":"2024-05-09T12:29:29.973591+0000","last_clean":"2024-05-09T12:29:29.973591+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:29:29.973591+0000","last_undegraded":"2024-05-09T12:29:29.973591+0000","last_fullsized":"2024-05-09T12:29:29.973591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2580,"log_dups_size":0,"ondisk_log_size":2580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:23.747102+0000","scrub_duration":0,"objects_trimmed":248,"snaptrim_duration":2.95797658,"stat_sum":{"num_bytes":2376,"num_objects":397,"num_object_clones":198,"num_object_copies":794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":397,"num_whiteouts":198,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.23","version":"34'2959","reported_seq":2398,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.144664+0000","last_change":"2024-05-09T12:29:30.144694+0000","last_active":"2024-05-09T12:29:30.144664+0000","last_peered":"2024-05-09T12:29:30.144664+0000","last_clean":"2024-05-09T12:29:30.144664+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:29:30.144664+0000","last_undegraded":"2024-05-09T12:29:30.144664+0000","last_fullsized":"2024-05-09T12:29:30.144664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":276,"snaptrim_duration":3.137882941,"stat_sum":{"num_bytes":2657,"num_objects":441,"num_object_clones":220,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":219,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.22","version":"34'2675","reported_seq":2198,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.705627+0000","last_change":"2024-05-09T12:29:31.705667+0000","last_active":"2024-05-09T12:29:31.705627+0000","last_peered":"2024-05-09T12:29:31.705627+0000","last_clean":"2024-05-09T12:29:31.705627+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:31.705627+0000","last_undegraded":"2024-05-09T12:29:31.705627+0000","last_fullsized":"2024-05-09T12:29:31.705627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":4.7063701230000001,"stat_sum":{"num_bytes":2217,"num_objects":370,"num_object_clones":184,"num_object_copies":740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":370,"num_whiteouts":184,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.21","version":"34'3147","reported_seq":2529,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.938013+0000","last_change":"2024-05-09T12:29:28.820322+0000","last_active":"2024-05-09T12:29:28.938013+0000","last_peered":"2024-05-09T12:29:28.938013+0000","last_clean":"2024-05-09T12:29:28.938013+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:28.938013+0000","last_undegraded":"2024-05-09T12:29:28.938013+0000","last_fullsized":"2024-05-09T12:29:28.938013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3147,"log_dups_size":0,"ondisk_log_size":3147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:16.312292+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":1.808559872,"stat_sum":{"num_bytes":2856,"num_objects":477,"num_object_clones":238,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.20","version":"34'3241","reported_seq":2666,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.125294+0000","last_change":"2024-05-09T12:29:32.125332+0000","last_active":"2024-05-09T12:29:32.125294+0000","last_peered":"2024-05-09T12:29:32.125294+0000","last_clean":"2024-05-09T12:29:32.125294+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:32.125294+0000","last_undegraded":"2024-05-09T12:29:32.125294+0000","last_fullsized":"2024-05-09T12:29:32.125294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:14:49.401316+0000","scrub_duration":0,"objects_trimmed":284,"snaptrim_duration":5.1249250140000004,"stat_sum":{"num_bytes":6784,"num_objects":450,"num_object_clones":224,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":224,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.14","version":"34'2903","reported_seq":2351,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.361442+0000","last_change":"2024-05-09T12:29:34.361479+0000","last_active":"2024-05-09T12:29:34.361442+0000","last_peered":"2024-05-09T12:29:34.361442+0000","last_clean":"2024-05-09T12:29:34.361442+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:29:34.361442+0000","last_undegraded":"2024-05-09T12:29:34.361442+0000","last_fullsized":"2024-05-09T12:29:34.361442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:55.441325+0000","scrub_duration":0,"objects_trimmed":277,"snaptrim_duration":7.3455076220000004,"stat_sum":{"num_bytes":10844,"num_objects":444,"num_object_clones":221,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":221,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.13","version":"32'4093","reported_seq":4144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000651+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:29:27.000651+0000","last_peered":"2024-05-09T12:29:27.000651+0000","last_clean":"2024-05-09T12:29:27.000651+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:27.000651+0000","last_undegraded":"2024-05-09T12:29:27.000651+0000","last_fullsized":"2024-05-09T12:29:27.000651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4093,"log_dups_size":0,"ondisk_log_size":4093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'2380","reported_seq":1964,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.902525+0000","last_change":"2024-05-09T12:29:25.994380+0000","last_active":"2024-05-09T12:29:28.902525+0000","last_peered":"2024-05-09T12:29:28.902525+0000","last_clean":"2024-05-09T12:29:28.902525+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:29:28.902525+0000","last_undegraded":"2024-05-09T12:29:28.902525+0000","last_fullsized":"2024-05-09T12:29:28.902525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.405652608,"stat_sum":{"num_bytes":5068,"num_objects":680,"num_object_clones":442,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":236,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003861+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:29:27.003861+0000","last_peered":"2024-05-09T12:29:27.003861+0000","last_clean":"2024-05-09T12:29:27.003861+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:27.003861+0000","last_undegraded":"2024-05-09T12:29:27.003861+0000","last_fullsized":"2024-05-09T12:29:27.003861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2605","reported_seq":2199,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962604+0000","last_change":"2024-05-09T12:29:25.989431+0000","last_active":"2024-05-09T12:29:28.962604+0000","last_peered":"2024-05-09T12:29:28.962604+0000","last_clean":"2024-05-09T12:29:28.962604+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:28.962604+0000","last_undegraded":"2024-05-09T12:29:28.962604+0000","last_fullsized":"2024-05-09T12:29:28.962604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:15:02.661928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2388007870000002,"stat_sum":{"num_bytes":4929,"num_objects":663,"num_object_clones":430,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":231,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"32'623","reported_seq":674,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000613+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:29:27.000613+0000","last_peered":"2024-05-09T12:29:27.000613+0000","last_clean":"2024-05-09T12:29:27.000613+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:27.000613+0000","last_undegraded":"2024-05-09T12:29:27.000613+0000","last_fullsized":"2024-05-09T12:29:27.000613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"34'2856","reported_seq":2321,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.441093+0000","last_change":"2024-05-09T12:29:34.441116+0000","last_active":"2024-05-09T12:29:34.441093+0000","last_peered":"2024-05-09T12:29:34.441093+0000","last_clean":"2024-05-09T12:29:34.441093+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:34.441093+0000","last_undegraded":"2024-05-09T12:29:34.441093+0000","last_fullsized":"2024-05-09T12:29:34.441093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:03:31.592242+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":7.4376879169999999,"stat_sum":{"num_bytes":6640,"num_objects":425,"num_object_clones":212,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.10","version":"32'57","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001159+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:29:27.001159+0000","last_peered":"2024-05-09T12:29:27.001159+0000","last_clean":"2024-05-09T12:29:27.001159+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:29:27.001159+0000","last_undegraded":"2024-05-09T12:29:27.001159+0000","last_fullsized":"2024-05-09T12:29:27.001159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1484","reported_seq":1536,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999804+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:29:26.999804+0000","last_peered":"2024-05-09T12:29:26.999804+0000","last_clean":"2024-05-09T12:29:26.999804+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:26.999804+0000","last_undegraded":"2024-05-09T12:29:26.999804+0000","last_fullsized":"2024-05-09T12:29:26.999804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'2827","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.069548+0000","last_change":"2024-05-09T12:29:30.069590+0000","last_active":"2024-05-09T12:29:30.069548+0000","last_peered":"2024-05-09T12:29:30.069548+0000","last_clean":"2024-05-09T12:29:30.069548+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:30.069548+0000","last_undegraded":"2024-05-09T12:29:30.069548+0000","last_fullsized":"2024-05-09T12:29:30.069548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2827,"log_dups_size":0,"ondisk_log_size":2827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:56.169314+0000","scrub_duration":0,"objects_trimmed":265,"snaptrim_duration":3.0684293020000002,"stat_sum":{"num_bytes":10676,"num_objects":418,"num_object_clones":207,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":207,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.e","version":"32'2803","reported_seq":2855,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000131+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:29:27.000131+0000","last_peered":"2024-05-09T12:29:27.000131+0000","last_clean":"2024-05-09T12:29:27.000131+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:27.000131+0000","last_undegraded":"2024-05-09T12:29:27.000131+0000","last_fullsized":"2024-05-09T12:29:27.000131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2951","reported_seq":2408,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.167589+0000","last_change":"2024-05-09T12:29:30.167611+0000","last_active":"2024-05-09T12:29:30.167589+0000","last_peered":"2024-05-09T12:29:30.167589+0000","last_clean":"2024-05-09T12:29:30.167589+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:29:30.167589+0000","last_undegraded":"2024-05-09T12:29:30.167589+0000","last_fullsized":"2024-05-09T12:29:30.167589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2951,"log_dups_size":0,"ondisk_log_size":2951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:05:54.659791+0000","scrub_duration":0,"objects_trimmed":263,"snaptrim_duration":3.1665112629999999,"stat_sum":{"num_bytes":2436,"num_objects":408,"num_object_clones":203,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":203,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.d","version":"32'6794","reported_seq":6846,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000422+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:29:27.000422+0000","last_peered":"2024-05-09T12:29:27.000422+0000","last_clean":"2024-05-09T12:29:27.000422+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:27.000422+0000","last_undegraded":"2024-05-09T12:29:27.000422+0000","last_fullsized":"2024-05-09T12:29:27.000422+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"34'2835","reported_seq":2298,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.611158+0000","last_change":"2024-05-09T12:29:33.611181+0000","last_active":"2024-05-09T12:29:33.611158+0000","last_peered":"2024-05-09T12:29:33.611158+0000","last_clean":"2024-05-09T12:29:33.611158+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:33.611158+0000","last_undegraded":"2024-05-09T12:29:33.611158+0000","last_fullsized":"2024-05-09T12:29:33.611158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:51:39.325653+0000","scrub_duration":0,"objects_trimmed":252,"snaptrim_duration":6.6119886640000001,"stat_sum":{"num_bytes":6640,"num_objects":426,"num_object_clones":212,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":426,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.c","version":"32'1921","reported_seq":1973,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000094+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:29:27.000094+0000","last_peered":"2024-05-09T12:29:27.000094+0000","last_clean":"2024-05-09T12:29:27.000094+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:29:27.000094+0000","last_undegraded":"2024-05-09T12:29:27.000094+0000","last_fullsized":"2024-05-09T12:29:27.000094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"34'2671","reported_seq":2181,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.817764+0000","last_change":"2024-05-09T12:29:33.817804+0000","last_active":"2024-05-09T12:29:33.817764+0000","last_peered":"2024-05-09T12:29:33.817764+0000","last_clean":"2024-05-09T12:29:33.817764+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:29:33.817764+0000","last_undegraded":"2024-05-09T12:29:33.817764+0000","last_fullsized":"2024-05-09T12:29:33.817764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":233,"snaptrim_duration":6.8108003190000002,"stat_sum":{"num_bytes":2371,"num_objects":392,"num_object_clones":196,"num_object_copies":784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":392,"num_whiteouts":195,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.b","version":"32'4536","reported_seq":4588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010258+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:29:27.010258+0000","last_peered":"2024-05-09T12:29:27.010258+0000","last_clean":"2024-05-09T12:29:27.010258+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:27.010258+0000","last_undegraded":"2024-05-09T12:29:27.010258+0000","last_fullsized":"2024-05-09T12:29:27.010258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'2879","reported_seq":2310,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.530504+0000","last_change":"2024-05-09T12:29:32.530548+0000","last_active":"2024-05-09T12:29:32.530504+0000","last_peered":"2024-05-09T12:29:32.530504+0000","last_clean":"2024-05-09T12:29:32.530504+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:29:32.530504+0000","last_undegraded":"2024-05-09T12:29:32.530504+0000","last_fullsized":"2024-05-09T12:29:32.530504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":272,"snaptrim_duration":5.5307278330000003,"stat_sum":{"num_bytes":10784,"num_objects":436,"num_object_clones":217,"num_object_copies":872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.a","version":"32'3404","reported_seq":3456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999488+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:29:26.999488+0000","last_peered":"2024-05-09T12:29:26.999488+0000","last_clean":"2024-05-09T12:29:26.999488+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:26.999488+0000","last_undegraded":"2024-05-09T12:29:26.999488+0000","last_fullsized":"2024-05-09T12:29:26.999488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2343","reported_seq":1936,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.922223+0000","last_change":"2024-05-09T12:29:25.993666+0000","last_active":"2024-05-09T12:29:28.922223+0000","last_peered":"2024-05-09T12:29:28.922223+0000","last_clean":"2024-05-09T12:29:28.922223+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:29:28.922223+0000","last_undegraded":"2024-05-09T12:29:28.922223+0000","last_fullsized":"2024-05-09T12:29:28.922223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4051755410000002,"stat_sum":{"num_bytes":5205,"num_objects":697,"num_object_clones":454,"num_object_copies":1394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":697,"num_whiteouts":243,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'1855","reported_seq":1907,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000832+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:29:27.000832+0000","last_peered":"2024-05-09T12:29:27.000832+0000","last_clean":"2024-05-09T12:29:27.000832+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:29:27.000832+0000","last_undegraded":"2024-05-09T12:29:27.000832+0000","last_fullsized":"2024-05-09T12:29:27.000832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"34'2913","reported_seq":2343,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950614+0000","last_change":"2024-05-09T12:29:28.402161+0000","last_active":"2024-05-09T12:29:28.950614+0000","last_peered":"2024-05-09T12:29:28.950614+0000","last_clean":"2024-05-09T12:29:28.950614+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:28.950614+0000","last_undegraded":"2024-05-09T12:29:28.950614+0000","last_fullsized":"2024-05-09T12:29:28.950614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:39:08.777335+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":1.402172266,"stat_sum":{"num_bytes":6772,"num_objects":449,"num_object_clones":223,"num_object_copies":898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":223,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.8","version":"32'178","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021383+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:29:27.021383+0000","last_peered":"2024-05-09T12:29:27.021383+0000","last_clean":"2024-05-09T12:29:27.021383+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:27.021383+0000","last_undegraded":"2024-05-09T12:29:27.021383+0000","last_fullsized":"2024-05-09T12:29:27.021383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'2804","reported_seq":2279,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.905787+0000","last_change":"2024-05-09T12:29:32.905824+0000","last_active":"2024-05-09T12:29:32.905787+0000","last_peered":"2024-05-09T12:29:32.905787+0000","last_clean":"2024-05-09T12:29:32.905787+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:32.905787+0000","last_undegraded":"2024-05-09T12:29:32.905787+0000","last_fullsized":"2024-05-09T12:29:32.905787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2804,"log_dups_size":0,"ondisk_log_size":2804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":5.8833810050000004,"stat_sum":{"num_bytes":6678,"num_objects":431,"num_object_clones":214,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001317+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:29:27.001317+0000","last_peered":"2024-05-09T12:29:27.001317+0000","last_clean":"2024-05-09T12:29:27.001317+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:27.001317+0000","last_undegraded":"2024-05-09T12:29:27.001317+0000","last_fullsized":"2024-05-09T12:29:27.001317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'4944","reported_seq":4996,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.014781+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:29:27.014781+0000","last_peered":"2024-05-09T12:29:27.014781+0000","last_clean":"2024-05-09T12:29:27.014781+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:27.014781+0000","last_undegraded":"2024-05-09T12:29:27.014781+0000","last_fullsized":"2024-05-09T12:29:27.014781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4944,"log_dups_size":0,"ondisk_log_size":4944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2366","reported_seq":1962,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.936244+0000","last_change":"2024-05-09T12:29:25.994046+0000","last_active":"2024-05-09T12:29:28.936244+0000","last_peered":"2024-05-09T12:29:28.936244+0000","last_clean":"2024-05-09T12:29:28.936244+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:29:28.936244+0000","last_undegraded":"2024-05-09T12:29:28.936244+0000","last_fullsized":"2024-05-09T12:29:28.936244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.684844134,"stat_sum":{"num_bytes":4883,"num_objects":655,"num_object_clones":426,"num_object_copies":1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":655,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000924+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:29:27.000924+0000","last_peered":"2024-05-09T12:29:27.000924+0000","last_clean":"2024-05-09T12:29:27.000924+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:27.000924+0000","last_undegraded":"2024-05-09T12:29:27.000924+0000","last_fullsized":"2024-05-09T12:29:27.000924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'1013","reported_seq":1065,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999404+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:29:26.999404+0000","last_peered":"2024-05-09T12:29:26.999404+0000","last_clean":"2024-05-09T12:29:26.999404+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:26.999404+0000","last_undegraded":"2024-05-09T12:29:26.999404+0000","last_fullsized":"2024-05-09T12:29:26.999404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'2439","reported_seq":1992,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.552655+0000","last_change":"2024-05-09T12:29:34.247014+0000","last_active":"2024-05-09T12:29:34.552655+0000","last_peered":"2024-05-09T12:29:34.552655+0000","last_clean":"2024-05-09T12:29:34.552655+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:34.552655+0000","last_undegraded":"2024-05-09T12:29:34.552655+0000","last_fullsized":"2024-05-09T12:29:34.552655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2439,"log_dups_size":0,"ondisk_log_size":2439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:04.684532+0000","scrub_duration":0,"objects_trimmed":74,"snaptrim_duration":2.7116899490000002,"stat_sum":{"num_bytes":4288,"num_objects":597,"num_object_clones":371,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597,"num_whiteouts":226,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999376+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:29:26.999376+0000","last_peered":"2024-05-09T12:29:26.999376+0000","last_clean":"2024-05-09T12:29:26.999376+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:26.999376+0000","last_undegraded":"2024-05-09T12:29:26.999376+0000","last_fullsized":"2024-05-09T12:29:26.999376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4164","reported_seq":4216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021467+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:29:27.021467+0000","last_peered":"2024-05-09T12:29:27.021467+0000","last_clean":"2024-05-09T12:29:27.021467+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:27.021467+0000","last_undegraded":"2024-05-09T12:29:27.021467+0000","last_fullsized":"2024-05-09T12:29:27.021467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2316","reported_seq":1912,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.549382+0000","last_change":"2024-05-09T12:29:34.361501+0000","last_active":"2024-05-09T12:29:34.549382+0000","last_peered":"2024-05-09T12:29:34.549382+0000","last_clean":"2024-05-09T12:29:34.549382+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:34.549382+0000","last_undegraded":"2024-05-09T12:29:34.549382+0000","last_fullsized":"2024-05-09T12:29:34.549382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":52,"snaptrim_duration":2.7116334420000001,"stat_sum":{"num_bytes":8716,"num_objects":633,"num_object_clones":401,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010407+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:29:27.010407+0000","last_peered":"2024-05-09T12:29:27.010407+0000","last_clean":"2024-05-09T12:29:27.010407+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:27.010407+0000","last_undegraded":"2024-05-09T12:29:27.010407+0000","last_fullsized":"2024-05-09T12:29:27.010407+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001224+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:29:27.001224+0000","last_peered":"2024-05-09T12:29:27.001224+0000","last_clean":"2024-05-09T12:29:27.001224+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:27.001224+0000","last_undegraded":"2024-05-09T12:29:27.001224+0000","last_fullsized":"2024-05-09T12:29:27.001224+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2644","reported_seq":2822,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.905869+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:29:27.905869+0000","last_peered":"2024-05-09T12:29:27.905869+0000","last_clean":"2024-05-09T12:29:27.905869+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:27.905869+0000","last_undegraded":"2024-05-09T12:29:27.905869+0000","last_fullsized":"2024-05-09T12:29:27.905869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2644,"log_dups_size":0,"ondisk_log_size":2644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"34'2398","reported_seq":1993,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.870020+0000","last_change":"2024-05-09T12:29:25.989124+0000","last_active":"2024-05-09T12:29:28.870020+0000","last_peered":"2024-05-09T12:29:28.870020+0000","last_clean":"2024-05-09T12:29:28.870020+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:28.870020+0000","last_undegraded":"2024-05-09T12:29:28.870020+0000","last_fullsized":"2024-05-09T12:29:28.870020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:54:43.130867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2019512539999999,"stat_sum":{"num_bytes":8824,"num_objects":633,"num_object_clones":413,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"34'1372","reported_seq":1424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:28.564512+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:29:28.564512+0000","last_peered":"2024-05-09T12:29:28.564512+0000","last_clean":"2024-05-09T12:29:28.564512+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:28.564512+0000","last_undegraded":"2024-05-09T12:29:28.564512+0000","last_fullsized":"2024-05-09T12:29:28.564512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1372,"log_dups_size":0,"ondisk_log_size":1372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340393,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1941,"num_write_kb":14182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016246+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:29:27.016246+0000","last_peered":"2024-05-09T12:29:27.016246+0000","last_clean":"2024-05-09T12:29:27.016246+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:27.016246+0000","last_undegraded":"2024-05-09T12:29:27.016246+0000","last_fullsized":"2024-05-09T12:29:27.016246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2659","reported_seq":2139,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.829724+0000","last_change":"2024-05-09T12:29:30.829774+0000","last_active":"2024-05-09T12:29:30.829724+0000","last_peered":"2024-05-09T12:29:30.829724+0000","last_clean":"2024-05-09T12:29:30.829724+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:30.829724+0000","last_undegraded":"2024-05-09T12:29:30.829724+0000","last_fullsized":"2024-05-09T12:29:30.829724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:09:19.316126+0000","scrub_duration":0,"objects_trimmed":259,"snaptrim_duration":3.8285190180000002,"stat_sum":{"num_bytes":10604,"num_objects":406,"num_object_clones":202,"num_object_copies":812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":406,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.7","version":"32'26","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.023253+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:29:27.023253+0000","last_peered":"2024-05-09T12:29:27.023253+0000","last_clean":"2024-05-09T12:29:27.023253+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:27.023253+0000","last_undegraded":"2024-05-09T12:29:27.023253+0000","last_fullsized":"2024-05-09T12:29:27.023253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001252+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:29:27.001252+0000","last_peered":"2024-05-09T12:29:27.001252+0000","last_clean":"2024-05-09T12:29:27.001252+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:27.001252+0000","last_undegraded":"2024-05-09T12:29:27.001252+0000","last_fullsized":"2024-05-09T12:29:27.001252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"34'2870","reported_seq":2290,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.975383+0000","last_change":"2024-05-09T12:29:27.522866+0000","last_active":"2024-05-09T12:29:28.975383+0000","last_peered":"2024-05-09T12:29:28.975383+0000","last_clean":"2024-05-09T12:29:28.975383+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:28.975383+0000","last_undegraded":"2024-05-09T12:29:28.975383+0000","last_fullsized":"2024-05-09T12:29:28.975383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":0.51712139599999996,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.4","version":"32'27","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016161+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:29:27.016161+0000","last_peered":"2024-05-09T12:29:27.016161+0000","last_clean":"2024-05-09T12:29:27.016161+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:27.016161+0000","last_undegraded":"2024-05-09T12:29:27.016161+0000","last_fullsized":"2024-05-09T12:29:27.016161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001385+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:29:27.001385+0000","last_peered":"2024-05-09T12:29:27.001385+0000","last_clean":"2024-05-09T12:29:27.001385+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:27.001385+0000","last_undegraded":"2024-05-09T12:29:27.001385+0000","last_fullsized":"2024-05-09T12:29:27.001385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"34'2783","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.537957+0000","last_change":"2024-05-09T12:29:33.817833+0000","last_active":"2024-05-09T12:29:34.537957+0000","last_peered":"2024-05-09T12:29:34.537957+0000","last_clean":"2024-05-09T12:29:34.537957+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:34.537957+0000","last_undegraded":"2024-05-09T12:29:34.537957+0000","last_fullsized":"2024-05-09T12:29:34.537957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2783,"log_dups_size":0,"ondisk_log_size":2783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":152,"snaptrim_duration":3.2020225899999999,"stat_sum":{"num_bytes":3977,"num_objects":579,"num_object_clones":342,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":579,"num_whiteouts":235,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'2124","reported_seq":2176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000878+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:29:27.000878+0000","last_peered":"2024-05-09T12:29:27.000878+0000","last_clean":"2024-05-09T12:29:27.000878+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:27.000878+0000","last_undegraded":"2024-05-09T12:29:27.000878+0000","last_fullsized":"2024-05-09T12:29:27.000878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999956+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:29:26.999956+0000","last_peered":"2024-05-09T12:29:26.999956+0000","last_clean":"2024-05-09T12:29:26.999956+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:26.999956+0000","last_undegraded":"2024-05-09T12:29:26.999956+0000","last_fullsized":"2024-05-09T12:29:26.999956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"34'2666","reported_seq":2182,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.802928+0000","last_change":"2024-05-09T12:29:32.802970+0000","last_active":"2024-05-09T12:29:32.802928+0000","last_peered":"2024-05-09T12:29:32.802928+0000","last_clean":"2024-05-09T12:29:32.802928+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:32.802928+0000","last_undegraded":"2024-05-09T12:29:32.802928+0000","last_fullsized":"2024-05-09T12:29:32.802928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2666,"log_dups_size":0,"ondisk_log_size":2666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:54:49.330336+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":5.7882296310000001,"stat_sum":{"num_bytes":10555,"num_objects":396,"num_object_clones":196,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.13","version":"34'2809","reported_seq":2257,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.497970+0000","last_change":"2024-05-09T12:29:33.611223+0000","last_active":"2024-05-09T12:29:34.497970+0000","last_peered":"2024-05-09T12:29:34.497970+0000","last_clean":"2024-05-09T12:29:34.497970+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:34.497970+0000","last_undegraded":"2024-05-09T12:29:34.497970+0000","last_fullsized":"2024-05-09T12:29:34.497970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:51.710645+0000","scrub_duration":0,"objects_trimmed":269,"snaptrim_duration":3.6833262630000001,"stat_sum":{"num_bytes":2735,"num_objects":451,"num_object_clones":229,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5456","reported_seq":5507,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000046+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:29:27.000046+0000","last_peered":"2024-05-09T12:29:27.000046+0000","last_clean":"2024-05-09T12:29:27.000046+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:27.000046+0000","last_undegraded":"2024-05-09T12:29:27.000046+0000","last_fullsized":"2024-05-09T12:29:27.000046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5456,"log_dups_size":0,"ondisk_log_size":5456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'2766","reported_seq":2255,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.564147+0000","last_change":"2024-05-09T12:29:31.564187+0000","last_active":"2024-05-09T12:29:31.564147+0000","last_peered":"2024-05-09T12:29:31.564147+0000","last_clean":"2024-05-09T12:29:31.564147+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:31.564147+0000","last_undegraded":"2024-05-09T12:29:31.564147+0000","last_fullsized":"2024-05-09T12:29:31.564147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:18.991011+0000","scrub_duration":0,"objects_trimmed":269,"snaptrim_duration":4.5494806859999999,"stat_sum":{"num_bytes":2364,"num_objects":399,"num_object_clones":198,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":399,"num_whiteouts":198,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.15","version":"34'3054","reported_seq":3105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000825+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:29:27.000825+0000","last_peered":"2024-05-09T12:29:27.000825+0000","last_clean":"2024-05-09T12:29:27.000825+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:27.000825+0000","last_undegraded":"2024-05-09T12:29:27.000825+0000","last_fullsized":"2024-05-09T12:29:27.000825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3054,"log_dups_size":0,"ondisk_log_size":3054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"32'3359","reported_seq":3410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000042+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:29:27.000042+0000","last_peered":"2024-05-09T12:29:27.000042+0000","last_clean":"2024-05-09T12:29:27.000042+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:27.000042+0000","last_undegraded":"2024-05-09T12:29:27.000042+0000","last_fullsized":"2024-05-09T12:29:27.000042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"34'2978","reported_seq":2389,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.264510+0000","last_change":"2024-05-09T12:29:29.264548+0000","last_active":"2024-05-09T12:29:29.264510+0000","last_peered":"2024-05-09T12:29:29.264510+0000","last_clean":"2024-05-09T12:29:29.264510+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:29.264510+0000","last_undegraded":"2024-05-09T12:29:29.264510+0000","last_fullsized":"2024-05-09T12:29:29.264510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2978,"log_dups_size":0,"ondisk_log_size":2978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":245,"snaptrim_duration":2.2554360889999998,"stat_sum":{"num_bytes":2677,"num_objects":431,"num_object_clones":215,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":213,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.17","version":"32'1016","reported_seq":1067,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003768+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:29:27.003768+0000","last_peered":"2024-05-09T12:29:27.003768+0000","last_clean":"2024-05-09T12:29:27.003768+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:27.003768+0000","last_undegraded":"2024-05-09T12:29:27.003768+0000","last_fullsized":"2024-05-09T12:29:27.003768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'2910","reported_seq":2363,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.897372+0000","last_change":"2024-05-09T12:29:27.229793+0000","last_active":"2024-05-09T12:29:28.897372+0000","last_peered":"2024-05-09T12:29:28.897372+0000","last_clean":"2024-05-09T12:29:28.897372+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:29:28.897372+0000","last_undegraded":"2024-05-09T12:29:28.897372+0000","last_fullsized":"2024-05-09T12:29:28.897372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2910,"log_dups_size":0,"ondisk_log_size":2910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":38,"snaptrim_duration":0.20858475700000001,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.1f","version":"34'2639","reported_seq":2171,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.975543+0000","last_change":"2024-05-09T12:29:33.975591+0000","last_active":"2024-05-09T12:29:33.975543+0000","last_peered":"2024-05-09T12:29:33.975543+0000","last_clean":"2024-05-09T12:29:33.975543+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:29:33.975543+0000","last_undegraded":"2024-05-09T12:29:33.975543+0000","last_fullsized":"2024-05-09T12:29:33.975543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2639,"log_dups_size":0,"ondisk_log_size":2639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":260,"snaptrim_duration":6.975877466,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.18","version":"32'2400","reported_seq":2451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021261+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:29:27.021261+0000","last_peered":"2024-05-09T12:29:27.021261+0000","last_clean":"2024-05-09T12:29:27.021261+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:27.021261+0000","last_undegraded":"2024-05-09T12:29:27.021261+0000","last_fullsized":"2024-05-09T12:29:27.021261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2298","reported_seq":1907,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.926515+0000","last_change":"2024-05-09T12:29:25.989450+0000","last_active":"2024-05-09T12:29:28.926515+0000","last_peered":"2024-05-09T12:29:28.926515+0000","last_clean":"2024-05-09T12:29:28.926515+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:28.926515+0000","last_undegraded":"2024-05-09T12:29:28.926515+0000","last_fullsized":"2024-05-09T12:29:28.926515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:30.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2003033439999999,"stat_sum":{"num_bytes":8818,"num_objects":636,"num_object_clones":412,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":222,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'762","reported_seq":813,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.011836+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:29:27.011836+0000","last_peered":"2024-05-09T12:29:27.011836+0000","last_clean":"2024-05-09T12:29:27.011836+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:27.011836+0000","last_undegraded":"2024-05-09T12:29:27.011836+0000","last_fullsized":"2024-05-09T12:29:27.011836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2757","reported_seq":2252,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.093580+0000","last_change":"2024-05-09T12:29:31.093619+0000","last_active":"2024-05-09T12:29:31.093580+0000","last_peered":"2024-05-09T12:29:31.093580+0000","last_clean":"2024-05-09T12:29:31.093580+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:31.093580+0000","last_undegraded":"2024-05-09T12:29:31.093580+0000","last_fullsized":"2024-05-09T12:29:31.093580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.0889008630000001,"stat_sum":{"num_bytes":2424,"num_objects":405,"num_object_clones":202,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1a","version":"32'6247","reported_seq":6298,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999456+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:29:26.999456+0000","last_peered":"2024-05-09T12:29:26.999456+0000","last_clean":"2024-05-09T12:29:26.999456+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:26.999456+0000","last_undegraded":"2024-05-09T12:29:26.999456+0000","last_fullsized":"2024-05-09T12:29:26.999456+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5947,"log_dups_size":0,"ondisk_log_size":5947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3116","reported_seq":2509,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.246948+0000","last_change":"2024-05-09T12:29:34.246982+0000","last_active":"2024-05-09T12:29:34.246948+0000","last_peered":"2024-05-09T12:29:34.246948+0000","last_clean":"2024-05-09T12:29:34.246948+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:34.246948+0000","last_undegraded":"2024-05-09T12:29:34.246948+0000","last_fullsized":"2024-05-09T12:29:34.246948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3116,"log_dups_size":0,"ondisk_log_size":3116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:17:38.392357+0000","scrub_duration":0,"objects_trimmed":300,"snaptrim_duration":7.2311749589999996,"stat_sum":{"num_bytes":2880,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1b","version":"32'3295","reported_seq":3346,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.007212+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:29:27.007212+0000","last_peered":"2024-05-09T12:29:27.007212+0000","last_clean":"2024-05-09T12:29:27.007212+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:27.007212+0000","last_undegraded":"2024-05-09T12:29:27.007212+0000","last_fullsized":"2024-05-09T12:29:27.007212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3295,"log_dups_size":0,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2281","reported_seq":1852,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.487908+0000","last_change":"2024-05-09T12:29:34.346806+0000","last_active":"2024-05-09T12:29:34.487908+0000","last_peered":"2024-05-09T12:29:34.487908+0000","last_clean":"2024-05-09T12:29:34.487908+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:34.487908+0000","last_undegraded":"2024-05-09T12:29:34.487908+0000","last_fullsized":"2024-05-09T12:29:34.487908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:45.377609+0000","scrub_duration":0,"objects_trimmed":42,"snaptrim_duration":3.681387118,"stat_sum":{"num_bytes":4997,"num_objects":675,"num_object_clones":434,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":675,"num_whiteouts":241,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'626","reported_seq":677,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999266+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:29:26.999266+0000","last_peered":"2024-05-09T12:29:26.999266+0000","last_clean":"2024-05-09T12:29:26.999266+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:26.999266+0000","last_undegraded":"2024-05-09T12:29:26.999266+0000","last_fullsized":"2024-05-09T12:29:26.999266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2793","reported_seq":2252,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.898295+0000","last_change":"2024-05-09T12:29:32.898334+0000","last_active":"2024-05-09T12:29:32.898295+0000","last_peered":"2024-05-09T12:29:32.898295+0000","last_clean":"2024-05-09T12:29:32.898295+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:29:32.898295+0000","last_undegraded":"2024-05-09T12:29:32.898295+0000","last_fullsized":"2024-05-09T12:29:32.898295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2793,"log_dups_size":0,"ondisk_log_size":2793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":273,"snaptrim_duration":5.8993531350000001,"stat_sum":{"num_bytes":2436,"num_objects":407,"num_object_clones":203,"num_object_copies":814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407,"num_whiteouts":203,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1d","version":"32'8181","reported_seq":8232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001864+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:29:27.001864+0000","last_peered":"2024-05-09T12:29:27.001864+0000","last_clean":"2024-05-09T12:29:27.001864+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:29:27.001864+0000","last_undegraded":"2024-05-09T12:29:27.001864+0000","last_fullsized":"2024-05-09T12:29:27.001864+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2684","reported_seq":2182,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.284285+0000","last_change":"2024-05-09T12:29:31.284327+0000","last_active":"2024-05-09T12:29:31.284285+0000","last_peered":"2024-05-09T12:29:31.284285+0000","last_clean":"2024-05-09T12:29:31.284285+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:31.284285+0000","last_undegraded":"2024-05-09T12:29:31.284285+0000","last_fullsized":"2024-05-09T12:29:31.284285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2684,"log_dups_size":0,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":4.2753868710000003,"stat_sum":{"num_bytes":2340,"num_objects":391,"num_object_clones":195,"num_object_copies":782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":391,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1e","version":"32'5552","reported_seq":5604,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.002688+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:29:27.002688+0000","last_peered":"2024-05-09T12:29:27.002688+0000","last_clean":"2024-05-09T12:29:27.002688+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:27.002688+0000","last_undegraded":"2024-05-09T12:29:27.002688+0000","last_fullsized":"2024-05-09T12:29:27.002688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5552,"log_dups_size":0,"ondisk_log_size":5552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'3289","reported_seq":2637,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.346746+0000","last_change":"2024-05-09T12:29:34.346786+0000","last_active":"2024-05-09T12:29:34.346746+0000","last_peered":"2024-05-09T12:29:34.346746+0000","last_clean":"2024-05-09T12:29:34.346746+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:34.346746+0000","last_undegraded":"2024-05-09T12:29:34.346746+0000","last_fullsized":"2024-05-09T12:29:34.346746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:41:38.978431+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":7.3450994969999996,"stat_sum":{"num_bytes":2951,"num_objects":494,"num_object_clones":246,"num_object_copies":988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":494,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1f","version":"32'2436","reported_seq":2488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003486+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:29:27.003486+0000","last_peered":"2024-05-09T12:29:27.003486+0000","last_clean":"2024-05-09T12:29:27.003486+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:27.003486+0000","last_undegraded":"2024-05-09T12:29:27.003486+0000","last_fullsized":"2024-05-09T12:29:27.003486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2436,"log_dups_size":0,"ondisk_log_size":2436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":316694,"num_objects":29765,"num_object_clones":16028,"num_object_copies":59530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29765,"num_whiteouts":13622,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131399680,"data_stored":632886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176722,"ondisk_log_size":176722,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287126729,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87025,"num_write_kb":575462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574316544,"data_stored":574253458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82350,"ondisk_log_size":82350,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705779,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782336,"kb_used_data":147252,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":93589504,"statfs":{"total":96636764160,"available":95835652096,"internally_reserved":0,"allocated":150786048,"data_stored":118339780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":650312135},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705779,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":967720,"kb_used_data":200724,"kb_used_omap":1,"kb_used_meta":766974,"kb_avail":93404120,"statfs":{"total":96636764160,"available":95645818880,"internally_reserved":0,"allocated":205541376,"data_stored":175414568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":785381829},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":591120,"kb_used_data":144896,"kb_used_omap":1,"kb_used_meta":446206,"kb_avail":93780720,"statfs":{"total":96636764160,"available":96031457280,"internally_reserved":0,"allocated":148373504,"data_stored":108711473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":456915397},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705781,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":808048,"kb_used_data":203548,"kb_used_omap":1,"kb_used_meta":604478,"kb_avail":93563792,"statfs":{"total":96636764160,"available":95809323008,"internally_reserved":0,"allocated":208433152,"data_stored":174159354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618985925},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173895680,"data_stored":173879793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107810816,"data_stored":107809385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34041856,"data_stored":142889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36524032,"data_stored":167128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28823552,"data_stored":152768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32010240,"data_stored":170101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:29:35.988 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T12:29:35.988 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:29:36.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.183+0000 7ff22d2af640 1 Processor -- start 2024-05-09T12:29:36.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.183+0000 7ff22d2af640 1 -- start start 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22d2af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff228071ee0 0x7ff228140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22d2af640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff228071420 con 0x7ff22813d9e0 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22d2af640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22809d2f0 con 0x7ff228141430 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22d2af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff2280716e0 con 0x7ff228071ee0 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22caae640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff22813d9e0 0x7ff228148c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42480/0 (socket says 172.21.15.135:42480) 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff227fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff228071ee0 0x7ff228140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.184+0000 7ff22caae640 1 -- 172.21.15.135:0/1812984274 learned_addr learned my addr 172.21.15.135:0/1812984274 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:36.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.185+0000 7ff227fff640 1 -- 172.21.15.135:0/1812984274 >> v1:172.21.15.160:6789/0 conn(0x7ff228141430 legacy=0x7ff22813d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:36.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.185+0000 7ff227fff640 1 -- 172.21.15.135:0/1812984274 >> v1:172.21.15.135:6789/0 conn(0x7ff22813d9e0 legacy=0x7ff228148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.185+0000 7ff227fff640 1 -- 172.21.15.135:0/1812984274 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280722c0 con 0x7ff228071ee0 2024-05-09T12:29:36.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.186+0000 7ff227fff640 1 --2- 172.21.15.135:0/1812984274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228140ef0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff22809d4c0 tx=0x7ff21802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424de84288607555 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.186+0000 7ff226ffd640 1 -- 172.21.15.135:0/1812984274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218039070 con 0x7ff228071ee0 2024-05-09T12:29:36.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.186+0000 7ff226ffd640 1 -- 172.21.15.135:0/1812984274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21802cb20 con 0x7ff228071ee0 2024-05-09T12:29:36.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.186+0000 7ff226ffd640 1 -- 172.21.15.135:0/1812984274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218034440 con 0x7ff228071ee0 2024-05-09T12:29:36.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.187+0000 7ff22d2af640 1 -- 172.21.15.135:0/1812984274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 msgr2=0x7ff228140ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.187+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1812984274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228140ef0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7ff22809d4c0 tx=0x7ff21802bd70 comp rx=0 tx=0).stop 2024-05-09T12:29:36.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.188+0000 7ff22d2af640 1 -- 172.21.15.135:0/1812984274 shutdown_connections 2024-05-09T12:29:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.188+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1812984274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228140ef0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.188+0000 7ff22d2af640 1 -- 172.21.15.135:0/1812984274 >> 172.21.15.135:0/1812984274 conn(0x7ff2280aaa10 msgr2=0x7ff2280aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.188+0000 7ff22d2af640 1 -- 172.21.15.135:0/1812984274 shutdown_connections 2024-05-09T12:29:36.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.189+0000 7ff22d2af640 1 -- 172.21.15.135:0/1812984274 wait complete. 2024-05-09T12:29:36.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.190+0000 7ff22d2af640 1 Processor -- start 2024-05-09T12:29:36.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.190+0000 7ff22d2af640 1 -- start start 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.191+0000 7ff22d2af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.191+0000 7ff22d2af640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.191+0000 7ff22d2af640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff228141430 0x7ff2281d6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.191+0000 7ff227fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.191+0000 7ff22d2af640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2280709a0 con 0x7ff228071ee0 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff22d2af640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff228070e10 con 0x7ff22813d9e0 2024-05-09T12:29:36.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff22d2af640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff2280a82e0 con 0x7ff228141430 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37268/0 (socket says 172.21.15.135:37268) 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41448/0 (socket says 172.21.15.135:41448) 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 -- 172.21.15.135:0/1724461327 learned_addr learned my addr 172.21.15.135:0/1724461327 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff22caae640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff228141430 0x7ff2281d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 -- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff228141430 msgr2=0x7ff2281d6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff228141430 0x7ff2281d6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 -- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 msgr2=0x7ff2281372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 -- 172.21.15.135:0/1724461327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280a0b30 con 0x7ff228071ee0 2024-05-09T12:29:36.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff2277fe640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:29:36.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.192+0000 7ff227fff640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7ff218037040 tx=0x7ff218004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.193+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218039050 con 0x7ff228071ee0 2024-05-09T12:29:36.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.193+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2280a1f70 con 0x7ff228071ee0 2024-05-09T12:29:36.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.193+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218045070 con 0x7ff228071ee0 2024-05-09T12:29:36.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.193+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2280a0f90 con 0x7ff228071ee0 2024-05-09T12:29:36.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.193+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218034e60 con 0x7ff228071ee0 2024-05-09T12:29:36.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.194+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2280507f0 con 0x7ff228071ee0 2024-05-09T12:29:36.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.195+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff218032b80 con 0x7ff228071ee0 2024-05-09T12:29:36.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.195+0000 7ff224ff9640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 0x7ff2080789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.195+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7ff218032980 con 0x7ff228071ee0 2024-05-09T12:29:36.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.196+0000 7ff2277fe640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 0x7ff2080789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.196+0000 7ff2277fe640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 0x7ff2080789c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2280aa860 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.201+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff218050020 con 0x7ff228071ee0 2024-05-09T12:29:36.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.492+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff228137810 con 0x7ff208076500 2024-05-09T12:29:36.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.503+0000 7ff224ff9640 1 -- 172.21.15.135:0/1724461327 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+274886 (secure 0 0 0) 0x7ff228137810 con 0x7ff208076500 2024-05-09T12:29:36.507 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:29:36.508 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.507+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 msgr2=0x7ff2080789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.507+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 0x7ff2080789c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2280aa860 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.507+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 msgr2=0x7ff228136d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.507+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7ff218037040 tx=0x7ff218004a40 comp rx=0 tx=0).stop 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 shutdown_connections 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff208076500 0x7ff2080789c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff228141430 0x7ff2281d6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff22813d9e0 0x7ff2281372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 --2- 172.21.15.135:0/1724461327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228071ee0 0x7ff228136d90 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 >> 172.21.15.135:0/1724461327 conn(0x7ff2280aaa10 msgr2=0x7ff2280a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:36.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 shutdown_connections 2024-05-09T12:29:36.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.508+0000 7ff22d2af640 1 -- 172.21.15.135:0/1724461327 wait complete. 2024-05-09T12:29:36.525 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-05-09T12:29:35.485117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":288033791,"num_objects":29884,"num_object_clones":16028,"num_object_copies":59768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29884,"num_whiteouts":13622,"num_read":255,"num_read_kb":3256,"num_write":164634,"num_write_kb":617687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":259144,"ondisk_log_size":259144,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3149224,"kb_used_data":696420,"kb_used_omap":6,"kb_used_meta":2452729,"kb_avail":374338136,"statfs":{"total":386547056640,"available":383322251264,"internally_reserved":0,"allocated":713134080,"data_stored":576625175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2511595286},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,5,3,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4890620,"num_objects":-13855,"num_object_clones":-12359,"num_object_copies":-27710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13855,"num_whiteouts":346,"num_read":3,"num_read_kb":184,"num_write":1879,"num_write_kb":4948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.499161"},"pg_stats":[{"pgid":"4.3f","version":"34'2278","reported_seq":1873,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.540169+0000","last_change":"2024-05-09T12:29:34.441134+0000","last_active":"2024-05-09T12:29:34.540169+0000","last_peered":"2024-05-09T12:29:34.540169+0000","last_clean":"2024-05-09T12:29:34.540169+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:29:34.540169+0000","last_undegraded":"2024-05-09T12:29:34.540169+0000","last_fullsized":"2024-05-09T12:29:34.540169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:08:18.309520+0000","scrub_duration":0,"objects_trimmed":22,"snaptrim_duration":3.2013429659999999,"stat_sum":{"num_bytes":4436,"num_objects":600,"num_object_clones":386,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":600,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2813","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.865638+0000","last_change":"2024-05-09T12:29:27.421182+0000","last_active":"2024-05-09T12:29:28.865638+0000","last_peered":"2024-05-09T12:29:28.865638+0000","last_clean":"2024-05-09T12:29:28.865638+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:29:28.865638+0000","last_undegraded":"2024-05-09T12:29:28.865638+0000","last_fullsized":"2024-05-09T12:29:28.865638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2813,"log_dups_size":0,"ondisk_log_size":2813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:35:26.401558+0000","scrub_duration":0,"objects_trimmed":64,"snaptrim_duration":0.42135249400000002,"stat_sum":{"num_bytes":2304,"num_objects":384,"num_object_clones":192,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":384,"num_whiteouts":192,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3d","version":"34'2725","reported_seq":2266,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.509085+0000","last_change":"2024-05-09T12:29:33.642801+0000","last_active":"2024-05-09T12:29:34.509085+0000","last_peered":"2024-05-09T12:29:34.509085+0000","last_clean":"2024-05-09T12:29:34.509085+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:34.509085+0000","last_undegraded":"2024-05-09T12:29:34.509085+0000","last_fullsized":"2024-05-09T12:29:34.509085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2725,"log_dups_size":0,"ondisk_log_size":2725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":176,"snaptrim_duration":3.4094307000000001,"stat_sum":{"num_bytes":3268,"num_objects":489,"num_object_clones":280,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":489,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'3004","reported_seq":2413,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.065797+0000","last_change":"2024-05-09T12:29:29.065840+0000","last_active":"2024-05-09T12:29:29.065797+0000","last_peered":"2024-05-09T12:29:29.065797+0000","last_clean":"2024-05-09T12:29:29.065797+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:29:29.065797+0000","last_undegraded":"2024-05-09T12:29:29.065797+0000","last_fullsized":"2024-05-09T12:29:29.065797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3004,"log_dups_size":0,"ondisk_log_size":3004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":2.066871688,"stat_sum":{"num_bytes":6936,"num_objects":470,"num_object_clones":234,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3b","version":"34'2489","reported_seq":2071,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962721+0000","last_change":"2024-05-09T12:29:25.988863+0000","last_active":"2024-05-09T12:29:28.962721+0000","last_peered":"2024-05-09T12:29:28.962721+0000","last_clean":"2024-05-09T12:29:28.962721+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:28.962721+0000","last_undegraded":"2024-05-09T12:29:28.962721+0000","last_fullsized":"2024-05-09T12:29:28.962721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2489,"log_dups_size":0,"ondisk_log_size":2489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2016601869999999,"stat_sum":{"num_bytes":5152,"num_objects":692,"num_object_clones":448,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":692,"num_whiteouts":243,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"34'2913","reported_seq":2396,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.333388+0000","last_change":"2024-05-09T12:29:30.333427+0000","last_active":"2024-05-09T12:29:30.333388+0000","last_peered":"2024-05-09T12:29:30.333388+0000","last_clean":"2024-05-09T12:29:30.333388+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:30.333388+0000","last_undegraded":"2024-05-09T12:29:30.333388+0000","last_fullsized":"2024-05-09T12:29:30.333388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":3.3343178679999999,"stat_sum":{"num_bytes":2558,"num_objects":428,"num_object_clones":213,"num_object_copies":856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":428,"num_whiteouts":213,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.39","version":"34'2840","reported_seq":2333,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950993+0000","last_change":"2024-05-09T12:29:27.270399+0000","last_active":"2024-05-09T12:29:28.950993+0000","last_peered":"2024-05-09T12:29:28.950993+0000","last_clean":"2024-05-09T12:29:28.950993+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:29:28.950993+0000","last_undegraded":"2024-05-09T12:29:28.950993+0000","last_fullsized":"2024-05-09T12:29:28.950993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":40,"snaptrim_duration":0.26985108400000002,"stat_sum":{"num_bytes":2448,"num_objects":411,"num_object_clones":204,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":411,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.38","version":"34'2735","reported_seq":2226,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.955573+0000","last_change":"2024-05-09T12:29:27.368044+0000","last_active":"2024-05-09T12:29:28.955573+0000","last_peered":"2024-05-09T12:29:28.955573+0000","last_clean":"2024-05-09T12:29:28.955573+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:28.955573+0000","last_undegraded":"2024-05-09T12:29:28.955573+0000","last_fullsized":"2024-05-09T12:29:28.955573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2735,"log_dups_size":0,"ondisk_log_size":2735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":56,"snaptrim_duration":0.36738837800000002,"stat_sum":{"num_bytes":6556,"num_objects":413,"num_object_clones":206,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.37","version":"34'2951","reported_seq":2415,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.704216+0000","last_change":"2024-05-09T12:29:32.704258+0000","last_active":"2024-05-09T12:29:32.704216+0000","last_peered":"2024-05-09T12:29:32.704216+0000","last_clean":"2024-05-09T12:29:32.704216+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:32.704216+0000","last_undegraded":"2024-05-09T12:29:32.704216+0000","last_fullsized":"2024-05-09T12:29:32.704216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2951,"log_dups_size":0,"ondisk_log_size":2951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":5.7016304350000002,"stat_sum":{"num_bytes":6579,"num_objects":416,"num_object_clones":206,"num_object_copies":832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.36","version":"34'2524","reported_seq":2067,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.385621+0000","last_change":"2024-05-09T12:29:32.385651+0000","last_active":"2024-05-09T12:29:32.385621+0000","last_peered":"2024-05-09T12:29:32.385621+0000","last_clean":"2024-05-09T12:29:32.385621+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:29:32.385621+0000","last_undegraded":"2024-05-09T12:29:32.385621+0000","last_fullsized":"2024-05-09T12:29:32.385621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2524,"log_dups_size":0,"ondisk_log_size":2524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:40.886862+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":5.3845229720000001,"stat_sum":{"num_bytes":6340,"num_objects":376,"num_object_clones":187,"num_object_copies":752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":376,"num_whiteouts":187,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.35","version":"34'2587","reported_seq":2113,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.939132+0000","last_change":"2024-05-09T12:29:27.177743+0000","last_active":"2024-05-09T12:29:28.939132+0000","last_peered":"2024-05-09T12:29:28.939132+0000","last_clean":"2024-05-09T12:29:28.939132+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:28.939132+0000","last_undegraded":"2024-05-09T12:29:28.939132+0000","last_fullsized":"2024-05-09T12:29:28.939132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2587,"log_dups_size":0,"ondisk_log_size":2587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:19:09.204008+0000","scrub_duration":0,"objects_trimmed":29,"snaptrim_duration":0.17742645300000001,"stat_sum":{"num_bytes":6436,"num_objects":394,"num_object_clones":195,"num_object_copies":788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":394,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.34","version":"34'2743","reported_seq":2207,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.147320+0000","last_change":"2024-05-09T12:29:30.147356+0000","last_active":"2024-05-09T12:29:30.147320+0000","last_peered":"2024-05-09T12:29:30.147320+0000","last_clean":"2024-05-09T12:29:30.147320+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:30.147320+0000","last_undegraded":"2024-05-09T12:29:30.147320+0000","last_fullsized":"2024-05-09T12:29:30.147320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2743,"log_dups_size":0,"ondisk_log_size":2743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:31.554547+0000","scrub_duration":0,"objects_trimmed":278,"snaptrim_duration":3.1348838529999998,"stat_sum":{"num_bytes":2616,"num_objects":442,"num_object_clones":220,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.33","version":"34'2859","reported_seq":2362,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.340953+0000","last_change":"2024-05-09T12:29:29.340994+0000","last_active":"2024-05-09T12:29:29.340953+0000","last_peered":"2024-05-09T12:29:29.340953+0000","last_clean":"2024-05-09T12:29:29.340953+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:29:29.340953+0000","last_undegraded":"2024-05-09T12:29:29.340953+0000","last_fullsized":"2024-05-09T12:29:29.340953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2859,"log_dups_size":0,"ondisk_log_size":2859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":2.3344210159999998,"stat_sum":{"num_bytes":6388,"num_objects":385,"num_object_clones":191,"num_object_copies":770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":385,"num_whiteouts":191,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.32","version":"34'3072","reported_seq":2520,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.706144+0000","last_change":"2024-05-09T12:29:31.706192+0000","last_active":"2024-05-09T12:29:31.706144+0000","last_peered":"2024-05-09T12:29:31.706144+0000","last_clean":"2024-05-09T12:29:31.706144+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:31.706144+0000","last_undegraded":"2024-05-09T12:29:31.706144+0000","last_fullsized":"2024-05-09T12:29:31.706144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":285,"snaptrim_duration":4.7073636969999999,"stat_sum":{"num_bytes":2604,"num_objects":438,"num_object_clones":218,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":438,"num_whiteouts":218,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.31","version":"34'2969","reported_seq":2431,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.994319+0000","last_change":"2024-05-09T12:29:29.994349+0000","last_active":"2024-05-09T12:29:29.994319+0000","last_peered":"2024-05-09T12:29:29.994319+0000","last_clean":"2024-05-09T12:29:29.994319+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:29:29.994319+0000","last_undegraded":"2024-05-09T12:29:29.994319+0000","last_fullsized":"2024-05-09T12:29:29.994319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:53.594808+0000","scrub_duration":0,"objects_trimmed":277,"snaptrim_duration":2.9934828869999999,"stat_sum":{"num_bytes":6640,"num_objects":427,"num_object_clones":213,"num_object_copies":854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.30","version":"34'2851","reported_seq":2318,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.110824+0000","last_change":"2024-05-09T12:29:29.110851+0000","last_active":"2024-05-09T12:29:29.110824+0000","last_peered":"2024-05-09T12:29:29.110824+0000","last_clean":"2024-05-09T12:29:29.110824+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:29.110824+0000","last_undegraded":"2024-05-09T12:29:29.110824+0000","last_fullsized":"2024-05-09T12:29:29.110824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:49:35.092328+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":2.1100265089999999,"stat_sum":{"num_bytes":6604,"num_objects":421,"num_object_clones":209,"num_object_copies":842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2f","version":"34'3100","reported_seq":2505,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.156770+0000","last_change":"2024-05-09T12:29:33.156806+0000","last_active":"2024-05-09T12:29:33.156770+0000","last_peered":"2024-05-09T12:29:33.156770+0000","last_clean":"2024-05-09T12:29:33.156770+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:33.156770+0000","last_undegraded":"2024-05-09T12:29:33.156770+0000","last_fullsized":"2024-05-09T12:29:33.156770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3100,"log_dups_size":0,"ondisk_log_size":3100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:06.956660+0000","scrub_duration":0,"objects_trimmed":298,"snaptrim_duration":6.1535401160000003,"stat_sum":{"num_bytes":2784,"num_objects":465,"num_object_clones":232,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2e","version":"34'2360","reported_seq":1932,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.642736+0000","last_change":"2024-05-09T12:29:33.642775+0000","last_active":"2024-05-09T12:29:33.642736+0000","last_peered":"2024-05-09T12:29:33.642736+0000","last_clean":"2024-05-09T12:29:33.642736+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:33.642736+0000","last_undegraded":"2024-05-09T12:29:33.642736+0000","last_fullsized":"2024-05-09T12:29:33.642736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2360,"log_dups_size":0,"ondisk_log_size":2360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:13:30.515742+0000","scrub_duration":0,"objects_trimmed":226,"snaptrim_duration":6.641452707,"stat_sum":{"num_bytes":2109,"num_objects":351,"num_object_clones":175,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":174,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2d","version":"34'2873","reported_seq":2367,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.349086+0000","last_change":"2024-05-09T12:29:30.349122+0000","last_active":"2024-05-09T12:29:30.349086+0000","last_peered":"2024-05-09T12:29:30.349086+0000","last_clean":"2024-05-09T12:29:30.349086+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:30.349086+0000","last_undegraded":"2024-05-09T12:29:30.349086+0000","last_fullsized":"2024-05-09T12:29:30.349086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2873,"log_dups_size":0,"ondisk_log_size":2873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.3445633849999998,"stat_sum":{"num_bytes":6568,"num_objects":415,"num_object_clones":206,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":206,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2c","version":"34'2913","reported_seq":2375,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.291751+0000","last_change":"2024-05-09T12:29:31.291779+0000","last_active":"2024-05-09T12:29:31.291751+0000","last_peered":"2024-05-09T12:29:31.291751+0000","last_clean":"2024-05-09T12:29:31.291751+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:31.291751+0000","last_undegraded":"2024-05-09T12:29:31.291751+0000","last_fullsized":"2024-05-09T12:29:31.291751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.2925059000000001,"stat_sum":{"num_bytes":10760,"num_objects":430,"num_object_clones":214,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2b","version":"34'2848","reported_seq":2363,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.834549+0000","last_change":"2024-05-09T12:29:32.834594+0000","last_active":"2024-05-09T12:29:32.834549+0000","last_peered":"2024-05-09T12:29:32.834549+0000","last_clean":"2024-05-09T12:29:32.834549+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:29:32.834549+0000","last_undegraded":"2024-05-09T12:29:32.834549+0000","last_fullsized":"2024-05-09T12:29:32.834549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":259,"snaptrim_duration":5.8356664780000003,"stat_sum":{"num_bytes":2316,"num_objects":389,"num_object_clones":194,"num_object_copies":778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":389,"num_whiteouts":194,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2a","version":"34'3014","reported_seq":2427,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.958563+0000","last_change":"2024-05-09T12:29:27.145173+0000","last_active":"2024-05-09T12:29:28.958563+0000","last_peered":"2024-05-09T12:29:28.958563+0000","last_clean":"2024-05-09T12:29:28.958563+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:28.958563+0000","last_undegraded":"2024-05-09T12:29:28.958563+0000","last_fullsized":"2024-05-09T12:29:28.958563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":27,"snaptrim_duration":0.14221557100000001,"stat_sum":{"num_bytes":6852,"num_objects":459,"num_object_clones":228,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":228,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.29","version":"34'2770","reported_seq":2284,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.972393+0000","last_change":"2024-05-09T12:29:26.822981+0000","last_active":"2024-05-09T12:29:28.972393+0000","last_peered":"2024-05-09T12:29:28.972393+0000","last_clean":"2024-05-09T12:29:28.972393+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:29:28.972393+0000","last_undegraded":"2024-05-09T12:29:28.972393+0000","last_fullsized":"2024-05-09T12:29:28.972393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:33:55.785696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.83230441099999997,"stat_sum":{"num_bytes":2352,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.28","version":"34'2994","reported_seq":2423,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.300844+0000","last_change":"2024-05-09T12:29:29.300886+0000","last_active":"2024-05-09T12:29:29.300844+0000","last_peered":"2024-05-09T12:29:29.300844+0000","last_clean":"2024-05-09T12:29:29.300844+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:29.300844+0000","last_undegraded":"2024-05-09T12:29:29.300844+0000","last_fullsized":"2024-05-09T12:29:29.300844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2994,"log_dups_size":0,"ondisk_log_size":2994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:42.345451+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":2.299868375,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.27","version":"34'2578","reported_seq":2106,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.966126+0000","last_change":"2024-05-09T12:29:28.747416+0000","last_active":"2024-05-09T12:29:28.966126+0000","last_peered":"2024-05-09T12:29:28.966126+0000","last_clean":"2024-05-09T12:29:28.966126+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:28.966126+0000","last_undegraded":"2024-05-09T12:29:28.966126+0000","last_fullsized":"2024-05-09T12:29:28.966126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2578,"log_dups_size":0,"ondisk_log_size":2578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":209,"snaptrim_duration":1.7251567159999999,"stat_sum":{"num_bytes":2184,"num_objects":365,"num_object_clones":182,"num_object_copies":730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":182,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.26","version":"34'3076","reported_seq":2512,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.179678+0000","last_change":"2024-05-09T12:29:31.179719+0000","last_active":"2024-05-09T12:29:31.179678+0000","last_peered":"2024-05-09T12:29:31.179678+0000","last_clean":"2024-05-09T12:29:31.179678+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:31.179678+0000","last_undegraded":"2024-05-09T12:29:31.179678+0000","last_fullsized":"2024-05-09T12:29:31.179678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3076,"log_dups_size":0,"ondisk_log_size":3076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:43:39.979039+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.1654695000000004,"stat_sum":{"num_bytes":2424,"num_objects":404,"num_object_clones":202,"num_object_copies":808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.25","version":"34'2457","reported_seq":2002,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.503769+0000","last_change":"2024-05-09T12:29:33.975582+0000","last_active":"2024-05-09T12:29:34.503769+0000","last_peered":"2024-05-09T12:29:34.503769+0000","last_clean":"2024-05-09T12:29:34.503769+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:29:34.503769+0000","last_undegraded":"2024-05-09T12:29:34.503769+0000","last_fullsized":"2024-05-09T12:29:34.503769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":103,"snaptrim_duration":3.4051381200000002,"stat_sum":{"num_bytes":3938,"num_objects":555,"num_object_clones":340,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2580","reported_seq":2102,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.973591+0000","last_change":"2024-05-09T12:29:29.973628+0000","last_active":"2024-05-09T12:29:29.973591+0000","last_peered":"2024-05-09T12:29:29.973591+0000","last_clean":"2024-05-09T12:29:29.973591+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:29:29.973591+0000","last_undegraded":"2024-05-09T12:29:29.973591+0000","last_fullsized":"2024-05-09T12:29:29.973591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2580,"log_dups_size":0,"ondisk_log_size":2580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:23.747102+0000","scrub_duration":0,"objects_trimmed":248,"snaptrim_duration":2.95797658,"stat_sum":{"num_bytes":2376,"num_objects":397,"num_object_clones":198,"num_object_copies":794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":397,"num_whiteouts":198,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.23","version":"34'2959","reported_seq":2398,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.144664+0000","last_change":"2024-05-09T12:29:30.144694+0000","last_active":"2024-05-09T12:29:30.144664+0000","last_peered":"2024-05-09T12:29:30.144664+0000","last_clean":"2024-05-09T12:29:30.144664+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:29:30.144664+0000","last_undegraded":"2024-05-09T12:29:30.144664+0000","last_fullsized":"2024-05-09T12:29:30.144664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":0,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":276,"snaptrim_duration":3.137882941,"stat_sum":{"num_bytes":2657,"num_objects":441,"num_object_clones":220,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":219,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.22","version":"34'2675","reported_seq":2198,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.705627+0000","last_change":"2024-05-09T12:29:31.705667+0000","last_active":"2024-05-09T12:29:31.705627+0000","last_peered":"2024-05-09T12:29:31.705627+0000","last_clean":"2024-05-09T12:29:31.705627+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:31.705627+0000","last_undegraded":"2024-05-09T12:29:31.705627+0000","last_fullsized":"2024-05-09T12:29:31.705627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":4.7063701230000001,"stat_sum":{"num_bytes":2217,"num_objects":370,"num_object_clones":184,"num_object_copies":740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":370,"num_whiteouts":184,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.21","version":"34'3147","reported_seq":2529,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.938013+0000","last_change":"2024-05-09T12:29:28.820322+0000","last_active":"2024-05-09T12:29:28.938013+0000","last_peered":"2024-05-09T12:29:28.938013+0000","last_clean":"2024-05-09T12:29:28.938013+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:28.938013+0000","last_undegraded":"2024-05-09T12:29:28.938013+0000","last_fullsized":"2024-05-09T12:29:28.938013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3147,"log_dups_size":0,"ondisk_log_size":3147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:16.312292+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":1.808559872,"stat_sum":{"num_bytes":2856,"num_objects":477,"num_object_clones":238,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":477,"num_whiteouts":238,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.20","version":"34'3241","reported_seq":2666,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.125294+0000","last_change":"2024-05-09T12:29:32.125332+0000","last_active":"2024-05-09T12:29:32.125294+0000","last_peered":"2024-05-09T12:29:32.125294+0000","last_clean":"2024-05-09T12:29:32.125294+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:32.125294+0000","last_undegraded":"2024-05-09T12:29:32.125294+0000","last_fullsized":"2024-05-09T12:29:32.125294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:14:49.401316+0000","scrub_duration":0,"objects_trimmed":284,"snaptrim_duration":5.1249250140000004,"stat_sum":{"num_bytes":6784,"num_objects":450,"num_object_clones":224,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":224,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.14","version":"34'2903","reported_seq":2351,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.361442+0000","last_change":"2024-05-09T12:29:34.361479+0000","last_active":"2024-05-09T12:29:34.361442+0000","last_peered":"2024-05-09T12:29:34.361442+0000","last_clean":"2024-05-09T12:29:34.361442+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:29:34.361442+0000","last_undegraded":"2024-05-09T12:29:34.361442+0000","last_fullsized":"2024-05-09T12:29:34.361442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:55.441325+0000","scrub_duration":0,"objects_trimmed":277,"snaptrim_duration":7.3455076220000004,"stat_sum":{"num_bytes":10844,"num_objects":444,"num_object_clones":221,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":221,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.13","version":"32'4093","reported_seq":4144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000651+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:29:27.000651+0000","last_peered":"2024-05-09T12:29:27.000651+0000","last_clean":"2024-05-09T12:29:27.000651+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:27.000651+0000","last_undegraded":"2024-05-09T12:29:27.000651+0000","last_fullsized":"2024-05-09T12:29:27.000651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4093,"log_dups_size":0,"ondisk_log_size":4093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'2380","reported_seq":1964,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.902525+0000","last_change":"2024-05-09T12:29:25.994380+0000","last_active":"2024-05-09T12:29:28.902525+0000","last_peered":"2024-05-09T12:29:28.902525+0000","last_clean":"2024-05-09T12:29:28.902525+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:29:28.902525+0000","last_undegraded":"2024-05-09T12:29:28.902525+0000","last_fullsized":"2024-05-09T12:29:28.902525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.405652608,"stat_sum":{"num_bytes":5068,"num_objects":680,"num_object_clones":442,"num_object_copies":1360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":680,"num_whiteouts":236,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003861+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:29:27.003861+0000","last_peered":"2024-05-09T12:29:27.003861+0000","last_clean":"2024-05-09T12:29:27.003861+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:27.003861+0000","last_undegraded":"2024-05-09T12:29:27.003861+0000","last_fullsized":"2024-05-09T12:29:27.003861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:04.286150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2605","reported_seq":2199,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.962604+0000","last_change":"2024-05-09T12:29:25.989431+0000","last_active":"2024-05-09T12:29:28.962604+0000","last_peered":"2024-05-09T12:29:28.962604+0000","last_clean":"2024-05-09T12:29:28.962604+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:28.962604+0000","last_undegraded":"2024-05-09T12:29:28.962604+0000","last_fullsized":"2024-05-09T12:29:28.962604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2605,"log_dups_size":0,"ondisk_log_size":2605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:15:02.661928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2388007870000002,"stat_sum":{"num_bytes":4929,"num_objects":663,"num_object_clones":430,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":663,"num_whiteouts":231,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"32'623","reported_seq":674,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000613+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:29:27.000613+0000","last_peered":"2024-05-09T12:29:27.000613+0000","last_clean":"2024-05-09T12:29:27.000613+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:27.000613+0000","last_undegraded":"2024-05-09T12:29:27.000613+0000","last_fullsized":"2024-05-09T12:29:27.000613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"34'2856","reported_seq":2321,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.441093+0000","last_change":"2024-05-09T12:29:34.441116+0000","last_active":"2024-05-09T12:29:34.441093+0000","last_peered":"2024-05-09T12:29:34.441093+0000","last_clean":"2024-05-09T12:29:34.441093+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:34.441093+0000","last_undegraded":"2024-05-09T12:29:34.441093+0000","last_fullsized":"2024-05-09T12:29:34.441093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:03:31.592242+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":7.4376879169999999,"stat_sum":{"num_bytes":6640,"num_objects":425,"num_object_clones":212,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.10","version":"32'57","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001159+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:29:27.001159+0000","last_peered":"2024-05-09T12:29:27.001159+0000","last_clean":"2024-05-09T12:29:27.001159+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:29:27.001159+0000","last_undegraded":"2024-05-09T12:29:27.001159+0000","last_fullsized":"2024-05-09T12:29:27.001159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1484","reported_seq":1536,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999804+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:29:26.999804+0000","last_peered":"2024-05-09T12:29:26.999804+0000","last_clean":"2024-05-09T12:29:26.999804+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:26.999804+0000","last_undegraded":"2024-05-09T12:29:26.999804+0000","last_fullsized":"2024-05-09T12:29:26.999804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'2827","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.069548+0000","last_change":"2024-05-09T12:29:30.069590+0000","last_active":"2024-05-09T12:29:30.069548+0000","last_peered":"2024-05-09T12:29:30.069548+0000","last_clean":"2024-05-09T12:29:30.069548+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:30.069548+0000","last_undegraded":"2024-05-09T12:29:30.069548+0000","last_fullsized":"2024-05-09T12:29:30.069548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2827,"log_dups_size":0,"ondisk_log_size":2827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:56.169314+0000","scrub_duration":0,"objects_trimmed":265,"snaptrim_duration":3.0684293020000002,"stat_sum":{"num_bytes":10676,"num_objects":418,"num_object_clones":207,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":207,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.e","version":"32'2803","reported_seq":2855,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000131+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:29:27.000131+0000","last_peered":"2024-05-09T12:29:27.000131+0000","last_clean":"2024-05-09T12:29:27.000131+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:27.000131+0000","last_undegraded":"2024-05-09T12:29:27.000131+0000","last_fullsized":"2024-05-09T12:29:27.000131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'2951","reported_seq":2408,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.167589+0000","last_change":"2024-05-09T12:29:30.167611+0000","last_active":"2024-05-09T12:29:30.167589+0000","last_peered":"2024-05-09T12:29:30.167589+0000","last_clean":"2024-05-09T12:29:30.167589+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:29:30.167589+0000","last_undegraded":"2024-05-09T12:29:30.167589+0000","last_fullsized":"2024-05-09T12:29:30.167589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2951,"log_dups_size":0,"ondisk_log_size":2951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:05:54.659791+0000","scrub_duration":0,"objects_trimmed":263,"snaptrim_duration":3.1665112629999999,"stat_sum":{"num_bytes":2436,"num_objects":408,"num_object_clones":203,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":203,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.d","version":"32'6794","reported_seq":6846,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000422+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:29:27.000422+0000","last_peered":"2024-05-09T12:29:27.000422+0000","last_clean":"2024-05-09T12:29:27.000422+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:27.000422+0000","last_undegraded":"2024-05-09T12:29:27.000422+0000","last_fullsized":"2024-05-09T12:29:27.000422+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"34'2835","reported_seq":2298,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.611158+0000","last_change":"2024-05-09T12:29:33.611181+0000","last_active":"2024-05-09T12:29:33.611158+0000","last_peered":"2024-05-09T12:29:33.611158+0000","last_clean":"2024-05-09T12:29:33.611158+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:33.611158+0000","last_undegraded":"2024-05-09T12:29:33.611158+0000","last_fullsized":"2024-05-09T12:29:33.611158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:51:39.325653+0000","scrub_duration":0,"objects_trimmed":252,"snaptrim_duration":6.6119886640000001,"stat_sum":{"num_bytes":6640,"num_objects":426,"num_object_clones":212,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":426,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.c","version":"32'1921","reported_seq":1973,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000094+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:29:27.000094+0000","last_peered":"2024-05-09T12:29:27.000094+0000","last_clean":"2024-05-09T12:29:27.000094+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:29:27.000094+0000","last_undegraded":"2024-05-09T12:29:27.000094+0000","last_fullsized":"2024-05-09T12:29:27.000094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"34'2671","reported_seq":2181,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.817764+0000","last_change":"2024-05-09T12:29:33.817804+0000","last_active":"2024-05-09T12:29:33.817764+0000","last_peered":"2024-05-09T12:29:33.817764+0000","last_clean":"2024-05-09T12:29:33.817764+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:29:33.817764+0000","last_undegraded":"2024-05-09T12:29:33.817764+0000","last_fullsized":"2024-05-09T12:29:33.817764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":233,"snaptrim_duration":6.8108003190000002,"stat_sum":{"num_bytes":2371,"num_objects":392,"num_object_clones":196,"num_object_copies":784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":392,"num_whiteouts":195,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.b","version":"32'4536","reported_seq":4588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010258+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:29:27.010258+0000","last_peered":"2024-05-09T12:29:27.010258+0000","last_clean":"2024-05-09T12:29:27.010258+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:27.010258+0000","last_undegraded":"2024-05-09T12:29:27.010258+0000","last_fullsized":"2024-05-09T12:29:27.010258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'2879","reported_seq":2310,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.530504+0000","last_change":"2024-05-09T12:29:32.530548+0000","last_active":"2024-05-09T12:29:32.530504+0000","last_peered":"2024-05-09T12:29:32.530504+0000","last_clean":"2024-05-09T12:29:32.530504+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:29:32.530504+0000","last_undegraded":"2024-05-09T12:29:32.530504+0000","last_fullsized":"2024-05-09T12:29:32.530504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":272,"snaptrim_duration":5.5307278330000003,"stat_sum":{"num_bytes":10784,"num_objects":436,"num_object_clones":217,"num_object_copies":872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.a","version":"32'3404","reported_seq":3456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999488+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:29:26.999488+0000","last_peered":"2024-05-09T12:29:26.999488+0000","last_clean":"2024-05-09T12:29:26.999488+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:26.999488+0000","last_undegraded":"2024-05-09T12:29:26.999488+0000","last_fullsized":"2024-05-09T12:29:26.999488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2343","reported_seq":1936,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.922223+0000","last_change":"2024-05-09T12:29:25.993666+0000","last_active":"2024-05-09T12:29:28.922223+0000","last_peered":"2024-05-09T12:29:28.922223+0000","last_clean":"2024-05-09T12:29:28.922223+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:29:28.922223+0000","last_undegraded":"2024-05-09T12:29:28.922223+0000","last_fullsized":"2024-05-09T12:29:28.922223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2343,"log_dups_size":0,"ondisk_log_size":2343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.4051755410000002,"stat_sum":{"num_bytes":5205,"num_objects":697,"num_object_clones":454,"num_object_copies":1394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":697,"num_whiteouts":243,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'1855","reported_seq":1907,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000832+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:29:27.000832+0000","last_peered":"2024-05-09T12:29:27.000832+0000","last_clean":"2024-05-09T12:29:27.000832+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:29:27.000832+0000","last_undegraded":"2024-05-09T12:29:27.000832+0000","last_fullsized":"2024-05-09T12:29:27.000832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"34'2913","reported_seq":2343,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.950614+0000","last_change":"2024-05-09T12:29:28.402161+0000","last_active":"2024-05-09T12:29:28.950614+0000","last_peered":"2024-05-09T12:29:28.950614+0000","last_clean":"2024-05-09T12:29:28.950614+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:28.950614+0000","last_undegraded":"2024-05-09T12:29:28.950614+0000","last_fullsized":"2024-05-09T12:29:28.950614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2913,"log_dups_size":0,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:39:08.777335+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":1.402172266,"stat_sum":{"num_bytes":6772,"num_objects":449,"num_object_clones":223,"num_object_copies":898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":449,"num_whiteouts":223,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.8","version":"32'178","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021383+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:29:27.021383+0000","last_peered":"2024-05-09T12:29:27.021383+0000","last_clean":"2024-05-09T12:29:27.021383+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:27.021383+0000","last_undegraded":"2024-05-09T12:29:27.021383+0000","last_fullsized":"2024-05-09T12:29:27.021383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'2804","reported_seq":2279,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.905787+0000","last_change":"2024-05-09T12:29:32.905824+0000","last_active":"2024-05-09T12:29:32.905787+0000","last_peered":"2024-05-09T12:29:32.905787+0000","last_clean":"2024-05-09T12:29:32.905787+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:32.905787+0000","last_undegraded":"2024-05-09T12:29:32.905787+0000","last_fullsized":"2024-05-09T12:29:32.905787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2804,"log_dups_size":0,"ondisk_log_size":2804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":5.8833810050000004,"stat_sum":{"num_bytes":6678,"num_objects":431,"num_object_clones":214,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001317+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:29:27.001317+0000","last_peered":"2024-05-09T12:29:27.001317+0000","last_clean":"2024-05-09T12:29:27.001317+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:27.001317+0000","last_undegraded":"2024-05-09T12:29:27.001317+0000","last_fullsized":"2024-05-09T12:29:27.001317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'4944","reported_seq":4996,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.014781+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:29:27.014781+0000","last_peered":"2024-05-09T12:29:27.014781+0000","last_clean":"2024-05-09T12:29:27.014781+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:27.014781+0000","last_undegraded":"2024-05-09T12:29:27.014781+0000","last_fullsized":"2024-05-09T12:29:27.014781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4944,"log_dups_size":0,"ondisk_log_size":4944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2366","reported_seq":1962,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.936244+0000","last_change":"2024-05-09T12:29:25.994046+0000","last_active":"2024-05-09T12:29:28.936244+0000","last_peered":"2024-05-09T12:29:28.936244+0000","last_clean":"2024-05-09T12:29:28.936244+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:29:28.936244+0000","last_undegraded":"2024-05-09T12:29:28.936244+0000","last_fullsized":"2024-05-09T12:29:28.936244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2366,"log_dups_size":0,"ondisk_log_size":2366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.684844134,"stat_sum":{"num_bytes":4883,"num_objects":655,"num_object_clones":426,"num_object_copies":1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":655,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000924+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:29:27.000924+0000","last_peered":"2024-05-09T12:29:27.000924+0000","last_clean":"2024-05-09T12:29:27.000924+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:27.000924+0000","last_undegraded":"2024-05-09T12:29:27.000924+0000","last_fullsized":"2024-05-09T12:29:27.000924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'1013","reported_seq":1065,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999404+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:29:26.999404+0000","last_peered":"2024-05-09T12:29:26.999404+0000","last_clean":"2024-05-09T12:29:26.999404+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:26.999404+0000","last_undegraded":"2024-05-09T12:29:26.999404+0000","last_fullsized":"2024-05-09T12:29:26.999404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'2439","reported_seq":1992,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.552655+0000","last_change":"2024-05-09T12:29:34.247014+0000","last_active":"2024-05-09T12:29:34.552655+0000","last_peered":"2024-05-09T12:29:34.552655+0000","last_clean":"2024-05-09T12:29:34.552655+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:34.552655+0000","last_undegraded":"2024-05-09T12:29:34.552655+0000","last_fullsized":"2024-05-09T12:29:34.552655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2439,"log_dups_size":0,"ondisk_log_size":2439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:04.684532+0000","scrub_duration":0,"objects_trimmed":74,"snaptrim_duration":2.7116899490000002,"stat_sum":{"num_bytes":4288,"num_objects":597,"num_object_clones":371,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":597,"num_whiteouts":226,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999376+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:29:26.999376+0000","last_peered":"2024-05-09T12:29:26.999376+0000","last_clean":"2024-05-09T12:29:26.999376+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:26.999376+0000","last_undegraded":"2024-05-09T12:29:26.999376+0000","last_fullsized":"2024-05-09T12:29:26.999376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4164","reported_seq":4216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021467+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:29:27.021467+0000","last_peered":"2024-05-09T12:29:27.021467+0000","last_clean":"2024-05-09T12:29:27.021467+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:27.021467+0000","last_undegraded":"2024-05-09T12:29:27.021467+0000","last_fullsized":"2024-05-09T12:29:27.021467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2316","reported_seq":1912,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.549382+0000","last_change":"2024-05-09T12:29:34.361501+0000","last_active":"2024-05-09T12:29:34.549382+0000","last_peered":"2024-05-09T12:29:34.549382+0000","last_clean":"2024-05-09T12:29:34.549382+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:34.549382+0000","last_undegraded":"2024-05-09T12:29:34.549382+0000","last_fullsized":"2024-05-09T12:29:34.549382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":52,"snaptrim_duration":2.7116334420000001,"stat_sum":{"num_bytes":8716,"num_objects":633,"num_object_clones":401,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010407+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:29:27.010407+0000","last_peered":"2024-05-09T12:29:27.010407+0000","last_clean":"2024-05-09T12:29:27.010407+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:27.010407+0000","last_undegraded":"2024-05-09T12:29:27.010407+0000","last_fullsized":"2024-05-09T12:29:27.010407+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001224+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:29:27.001224+0000","last_peered":"2024-05-09T12:29:27.001224+0000","last_clean":"2024-05-09T12:29:27.001224+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:27.001224+0000","last_undegraded":"2024-05-09T12:29:27.001224+0000","last_fullsized":"2024-05-09T12:29:27.001224+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2644","reported_seq":2822,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.905869+0000","last_change":"2024-05-09T12:20:20.626894+0000","last_active":"2024-05-09T12:29:27.905869+0000","last_peered":"2024-05-09T12:29:27.905869+0000","last_clean":"2024-05-09T12:29:27.905869+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:27.905869+0000","last_undegraded":"2024-05-09T12:29:27.905869+0000","last_fullsized":"2024-05-09T12:29:27.905869+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2644,"log_dups_size":0,"ondisk_log_size":2644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"34'2398","reported_seq":1993,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.870020+0000","last_change":"2024-05-09T12:29:25.989124+0000","last_active":"2024-05-09T12:29:28.870020+0000","last_peered":"2024-05-09T12:29:28.870020+0000","last_clean":"2024-05-09T12:29:28.870020+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:28.870020+0000","last_undegraded":"2024-05-09T12:29:28.870020+0000","last_fullsized":"2024-05-09T12:29:28.870020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:54:43.130867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2019512539999999,"stat_sum":{"num_bytes":8824,"num_objects":633,"num_object_clones":413,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":633,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"34'1372","reported_seq":1424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:28.564512+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:29:28.564512+0000","last_peered":"2024-05-09T12:29:28.564512+0000","last_clean":"2024-05-09T12:29:28.564512+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:28.564512+0000","last_undegraded":"2024-05-09T12:29:28.564512+0000","last_fullsized":"2024-05-09T12:29:28.564512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1372,"log_dups_size":0,"ondisk_log_size":1372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340393,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1941,"num_write_kb":14182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016246+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:29:27.016246+0000","last_peered":"2024-05-09T12:29:27.016246+0000","last_clean":"2024-05-09T12:29:27.016246+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:27.016246+0000","last_undegraded":"2024-05-09T12:29:27.016246+0000","last_fullsized":"2024-05-09T12:29:27.016246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2659","reported_seq":2139,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:30.829724+0000","last_change":"2024-05-09T12:29:30.829774+0000","last_active":"2024-05-09T12:29:30.829724+0000","last_peered":"2024-05-09T12:29:30.829724+0000","last_clean":"2024-05-09T12:29:30.829724+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:30.829724+0000","last_undegraded":"2024-05-09T12:29:30.829724+0000","last_fullsized":"2024-05-09T12:29:30.829724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:09:19.316126+0000","scrub_duration":0,"objects_trimmed":259,"snaptrim_duration":3.8285190180000002,"stat_sum":{"num_bytes":10604,"num_objects":406,"num_object_clones":202,"num_object_copies":812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":406,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.7","version":"32'26","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.023253+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:29:27.023253+0000","last_peered":"2024-05-09T12:29:27.023253+0000","last_clean":"2024-05-09T12:29:27.023253+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:27.023253+0000","last_undegraded":"2024-05-09T12:29:27.023253+0000","last_fullsized":"2024-05-09T12:29:27.023253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001252+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:29:27.001252+0000","last_peered":"2024-05-09T12:29:27.001252+0000","last_clean":"2024-05-09T12:29:27.001252+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:27.001252+0000","last_undegraded":"2024-05-09T12:29:27.001252+0000","last_fullsized":"2024-05-09T12:29:27.001252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"34'2870","reported_seq":2290,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.975383+0000","last_change":"2024-05-09T12:29:27.522866+0000","last_active":"2024-05-09T12:29:28.975383+0000","last_peered":"2024-05-09T12:29:28.975383+0000","last_clean":"2024-05-09T12:29:28.975383+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:28.975383+0000","last_undegraded":"2024-05-09T12:29:28.975383+0000","last_fullsized":"2024-05-09T12:29:28.975383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":0.51712139599999996,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.4","version":"32'27","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016161+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:29:27.016161+0000","last_peered":"2024-05-09T12:29:27.016161+0000","last_clean":"2024-05-09T12:29:27.016161+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:27.016161+0000","last_undegraded":"2024-05-09T12:29:27.016161+0000","last_fullsized":"2024-05-09T12:29:27.016161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001385+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:29:27.001385+0000","last_peered":"2024-05-09T12:29:27.001385+0000","last_clean":"2024-05-09T12:29:27.001385+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:27.001385+0000","last_undegraded":"2024-05-09T12:29:27.001385+0000","last_fullsized":"2024-05-09T12:29:27.001385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"34'2783","reported_seq":2295,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.537957+0000","last_change":"2024-05-09T12:29:33.817833+0000","last_active":"2024-05-09T12:29:34.537957+0000","last_peered":"2024-05-09T12:29:34.537957+0000","last_clean":"2024-05-09T12:29:34.537957+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:34.537957+0000","last_undegraded":"2024-05-09T12:29:34.537957+0000","last_fullsized":"2024-05-09T12:29:34.537957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2783,"log_dups_size":0,"ondisk_log_size":2783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":152,"snaptrim_duration":3.2020225899999999,"stat_sum":{"num_bytes":3977,"num_objects":579,"num_object_clones":342,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":579,"num_whiteouts":235,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'2124","reported_seq":2176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000878+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:29:27.000878+0000","last_peered":"2024-05-09T12:29:27.000878+0000","last_clean":"2024-05-09T12:29:27.000878+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:27.000878+0000","last_undegraded":"2024-05-09T12:29:27.000878+0000","last_fullsized":"2024-05-09T12:29:27.000878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999956+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:29:26.999956+0000","last_peered":"2024-05-09T12:29:26.999956+0000","last_clean":"2024-05-09T12:29:26.999956+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:26.999956+0000","last_undegraded":"2024-05-09T12:29:26.999956+0000","last_fullsized":"2024-05-09T12:29:26.999956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"34'2666","reported_seq":2182,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.802928+0000","last_change":"2024-05-09T12:29:32.802970+0000","last_active":"2024-05-09T12:29:32.802928+0000","last_peered":"2024-05-09T12:29:32.802928+0000","last_clean":"2024-05-09T12:29:32.802928+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:32.802928+0000","last_undegraded":"2024-05-09T12:29:32.802928+0000","last_fullsized":"2024-05-09T12:29:32.802928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2666,"log_dups_size":0,"ondisk_log_size":2666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:54:49.330336+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":5.7882296310000001,"stat_sum":{"num_bytes":10555,"num_objects":396,"num_object_clones":196,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.13","version":"34'2809","reported_seq":2257,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.497970+0000","last_change":"2024-05-09T12:29:33.611223+0000","last_active":"2024-05-09T12:29:34.497970+0000","last_peered":"2024-05-09T12:29:34.497970+0000","last_clean":"2024-05-09T12:29:34.497970+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:34.497970+0000","last_undegraded":"2024-05-09T12:29:34.497970+0000","last_fullsized":"2024-05-09T12:29:34.497970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:51.710645+0000","scrub_duration":0,"objects_trimmed":269,"snaptrim_duration":3.6833262630000001,"stat_sum":{"num_bytes":2735,"num_objects":451,"num_object_clones":229,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5456","reported_seq":5507,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000046+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:29:27.000046+0000","last_peered":"2024-05-09T12:29:27.000046+0000","last_clean":"2024-05-09T12:29:27.000046+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:27.000046+0000","last_undegraded":"2024-05-09T12:29:27.000046+0000","last_fullsized":"2024-05-09T12:29:27.000046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5456,"log_dups_size":0,"ondisk_log_size":5456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'2766","reported_seq":2255,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.564147+0000","last_change":"2024-05-09T12:29:31.564187+0000","last_active":"2024-05-09T12:29:31.564147+0000","last_peered":"2024-05-09T12:29:31.564147+0000","last_clean":"2024-05-09T12:29:31.564147+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:31.564147+0000","last_undegraded":"2024-05-09T12:29:31.564147+0000","last_fullsized":"2024-05-09T12:29:31.564147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2766,"log_dups_size":0,"ondisk_log_size":2766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:18.991011+0000","scrub_duration":0,"objects_trimmed":269,"snaptrim_duration":4.5494806859999999,"stat_sum":{"num_bytes":2364,"num_objects":399,"num_object_clones":198,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":399,"num_whiteouts":198,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.15","version":"34'3054","reported_seq":3105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000825+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:29:27.000825+0000","last_peered":"2024-05-09T12:29:27.000825+0000","last_clean":"2024-05-09T12:29:27.000825+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:27.000825+0000","last_undegraded":"2024-05-09T12:29:27.000825+0000","last_fullsized":"2024-05-09T12:29:27.000825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3054,"log_dups_size":0,"ondisk_log_size":3054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"32'3359","reported_seq":3410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000042+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:29:27.000042+0000","last_peered":"2024-05-09T12:29:27.000042+0000","last_clean":"2024-05-09T12:29:27.000042+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:27.000042+0000","last_undegraded":"2024-05-09T12:29:27.000042+0000","last_fullsized":"2024-05-09T12:29:27.000042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"34'2978","reported_seq":2389,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:29.264510+0000","last_change":"2024-05-09T12:29:29.264548+0000","last_active":"2024-05-09T12:29:29.264510+0000","last_peered":"2024-05-09T12:29:29.264510+0000","last_clean":"2024-05-09T12:29:29.264510+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:29.264510+0000","last_undegraded":"2024-05-09T12:29:29.264510+0000","last_fullsized":"2024-05-09T12:29:29.264510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2978,"log_dups_size":0,"ondisk_log_size":2978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":245,"snaptrim_duration":2.2554360889999998,"stat_sum":{"num_bytes":2677,"num_objects":431,"num_object_clones":215,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":213,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.17","version":"32'1016","reported_seq":1067,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003768+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:29:27.003768+0000","last_peered":"2024-05-09T12:29:27.003768+0000","last_clean":"2024-05-09T12:29:27.003768+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:27.003768+0000","last_undegraded":"2024-05-09T12:29:27.003768+0000","last_fullsized":"2024-05-09T12:29:27.003768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'2910","reported_seq":2363,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.897372+0000","last_change":"2024-05-09T12:29:27.229793+0000","last_active":"2024-05-09T12:29:28.897372+0000","last_peered":"2024-05-09T12:29:28.897372+0000","last_clean":"2024-05-09T12:29:28.897372+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:29:28.897372+0000","last_undegraded":"2024-05-09T12:29:28.897372+0000","last_fullsized":"2024-05-09T12:29:28.897372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2910,"log_dups_size":0,"ondisk_log_size":2910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":38,"snaptrim_duration":0.20858475700000001,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.1f","version":"34'2639","reported_seq":2171,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.975543+0000","last_change":"2024-05-09T12:29:33.975591+0000","last_active":"2024-05-09T12:29:33.975543+0000","last_peered":"2024-05-09T12:29:33.975543+0000","last_clean":"2024-05-09T12:29:33.975543+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:29:33.975543+0000","last_undegraded":"2024-05-09T12:29:33.975543+0000","last_fullsized":"2024-05-09T12:29:33.975543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2639,"log_dups_size":0,"ondisk_log_size":2639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":260,"snaptrim_duration":6.975877466,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.18","version":"32'2400","reported_seq":2451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021261+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:29:27.021261+0000","last_peered":"2024-05-09T12:29:27.021261+0000","last_clean":"2024-05-09T12:29:27.021261+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:27.021261+0000","last_undegraded":"2024-05-09T12:29:27.021261+0000","last_fullsized":"2024-05-09T12:29:27.021261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2298","reported_seq":1907,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:28.926515+0000","last_change":"2024-05-09T12:29:25.989450+0000","last_active":"2024-05-09T12:29:28.926515+0000","last_peered":"2024-05-09T12:29:28.926515+0000","last_clean":"2024-05-09T12:29:28.926515+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:28.926515+0000","last_undegraded":"2024-05-09T12:29:28.926515+0000","last_fullsized":"2024-05-09T12:29:28.926515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:30.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.2003033439999999,"stat_sum":{"num_bytes":8818,"num_objects":636,"num_object_clones":412,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":222,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'762","reported_seq":813,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.011836+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:29:27.011836+0000","last_peered":"2024-05-09T12:29:27.011836+0000","last_clean":"2024-05-09T12:29:27.011836+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:27.011836+0000","last_undegraded":"2024-05-09T12:29:27.011836+0000","last_fullsized":"2024-05-09T12:29:27.011836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2757","reported_seq":2252,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.093580+0000","last_change":"2024-05-09T12:29:31.093619+0000","last_active":"2024-05-09T12:29:31.093580+0000","last_peered":"2024-05-09T12:29:31.093580+0000","last_clean":"2024-05-09T12:29:31.093580+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:31.093580+0000","last_undegraded":"2024-05-09T12:29:31.093580+0000","last_fullsized":"2024-05-09T12:29:31.093580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.0889008630000001,"stat_sum":{"num_bytes":2424,"num_objects":405,"num_object_clones":202,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1a","version":"32'6247","reported_seq":6298,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999456+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:29:26.999456+0000","last_peered":"2024-05-09T12:29:26.999456+0000","last_clean":"2024-05-09T12:29:26.999456+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:26.999456+0000","last_undegraded":"2024-05-09T12:29:26.999456+0000","last_fullsized":"2024-05-09T12:29:26.999456+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5947,"log_dups_size":0,"ondisk_log_size":5947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3116","reported_seq":2509,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.246948+0000","last_change":"2024-05-09T12:29:34.246982+0000","last_active":"2024-05-09T12:29:34.246948+0000","last_peered":"2024-05-09T12:29:34.246948+0000","last_clean":"2024-05-09T12:29:34.246948+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:34.246948+0000","last_undegraded":"2024-05-09T12:29:34.246948+0000","last_fullsized":"2024-05-09T12:29:34.246948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3116,"log_dups_size":0,"ondisk_log_size":3116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:17:38.392357+0000","scrub_duration":0,"objects_trimmed":300,"snaptrim_duration":7.2311749589999996,"stat_sum":{"num_bytes":2880,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1b","version":"32'3295","reported_seq":3346,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.007212+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:29:27.007212+0000","last_peered":"2024-05-09T12:29:27.007212+0000","last_clean":"2024-05-09T12:29:27.007212+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:27.007212+0000","last_undegraded":"2024-05-09T12:29:27.007212+0000","last_fullsized":"2024-05-09T12:29:27.007212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3295,"log_dups_size":0,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2281","reported_seq":1852,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:34.487908+0000","last_change":"2024-05-09T12:29:34.346806+0000","last_active":"2024-05-09T12:29:34.487908+0000","last_peered":"2024-05-09T12:29:34.487908+0000","last_clean":"2024-05-09T12:29:34.487908+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:34.487908+0000","last_undegraded":"2024-05-09T12:29:34.487908+0000","last_fullsized":"2024-05-09T12:29:34.487908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2281,"log_dups_size":0,"ondisk_log_size":2281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:45.377609+0000","scrub_duration":0,"objects_trimmed":42,"snaptrim_duration":3.681387118,"stat_sum":{"num_bytes":4997,"num_objects":675,"num_object_clones":434,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":675,"num_whiteouts":241,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'626","reported_seq":677,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999266+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:29:26.999266+0000","last_peered":"2024-05-09T12:29:26.999266+0000","last_clean":"2024-05-09T12:29:26.999266+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:26.999266+0000","last_undegraded":"2024-05-09T12:29:26.999266+0000","last_fullsized":"2024-05-09T12:29:26.999266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2793","reported_seq":2252,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.898295+0000","last_change":"2024-05-09T12:29:32.898334+0000","last_active":"2024-05-09T12:29:32.898295+0000","last_peered":"2024-05-09T12:29:32.898295+0000","last_clean":"2024-05-09T12:29:32.898295+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:29:32.898295+0000","last_undegraded":"2024-05-09T12:29:32.898295+0000","last_fullsized":"2024-05-09T12:29:32.898295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2793,"log_dups_size":0,"ondisk_log_size":2793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":273,"snaptrim_duration":5.8993531350000001,"stat_sum":{"num_bytes":2436,"num_objects":407,"num_object_clones":203,"num_object_copies":814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407,"num_whiteouts":203,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1d","version":"32'8181","reported_seq":8232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001864+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:29:27.001864+0000","last_peered":"2024-05-09T12:29:27.001864+0000","last_clean":"2024-05-09T12:29:27.001864+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:29:27.001864+0000","last_undegraded":"2024-05-09T12:29:27.001864+0000","last_fullsized":"2024-05-09T12:29:27.001864+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2684","reported_seq":2182,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.284285+0000","last_change":"2024-05-09T12:29:31.284327+0000","last_active":"2024-05-09T12:29:31.284285+0000","last_peered":"2024-05-09T12:29:31.284285+0000","last_clean":"2024-05-09T12:29:31.284285+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:31.284285+0000","last_undegraded":"2024-05-09T12:29:31.284285+0000","last_fullsized":"2024-05-09T12:29:31.284285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2684,"log_dups_size":0,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":4.2753868710000003,"stat_sum":{"num_bytes":2340,"num_objects":391,"num_object_clones":195,"num_object_copies":782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":391,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1e","version":"32'5552","reported_seq":5604,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.002688+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:29:27.002688+0000","last_peered":"2024-05-09T12:29:27.002688+0000","last_clean":"2024-05-09T12:29:27.002688+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:27.002688+0000","last_undegraded":"2024-05-09T12:29:27.002688+0000","last_fullsized":"2024-05-09T12:29:27.002688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5552,"log_dups_size":0,"ondisk_log_size":5552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:53.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'3289","reported_seq":2637,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.346746+0000","last_change":"2024-05-09T12:29:34.346786+0000","last_active":"2024-05-09T12:29:34.346746+0000","last_peered":"2024-05-09T12:29:34.346746+0000","last_clean":"2024-05-09T12:29:34.346746+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:34.346746+0000","last_undegraded":"2024-05-09T12:29:34.346746+0000","last_fullsized":"2024-05-09T12:29:34.346746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:41:38.978431+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":7.3450994969999996,"stat_sum":{"num_bytes":2951,"num_objects":494,"num_object_clones":246,"num_object_copies":988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":494,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1f","version":"32'2436","reported_seq":2488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003486+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:29:27.003486+0000","last_peered":"2024-05-09T12:29:27.003486+0000","last_clean":"2024-05-09T12:29:27.003486+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:27.003486+0000","last_undegraded":"2024-05-09T12:29:27.003486+0000","last_fullsized":"2024-05-09T12:29:27.003486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2436,"log_dups_size":0,"ondisk_log_size":2436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":316694,"num_objects":29765,"num_object_clones":16028,"num_object_copies":59530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29765,"num_whiteouts":13622,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131399680,"data_stored":632886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176722,"ondisk_log_size":176722,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287126729,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87025,"num_write_kb":575462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574316544,"data_stored":574253458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82350,"ondisk_log_size":82350,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705779,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782336,"kb_used_data":147252,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":93589504,"statfs":{"total":96636764160,"available":95835652096,"internally_reserved":0,"allocated":150786048,"data_stored":118339780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":650312135},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705779,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":967720,"kb_used_data":200724,"kb_used_omap":1,"kb_used_meta":766974,"kb_avail":93404120,"statfs":{"total":96636764160,"available":95645818880,"internally_reserved":0,"allocated":205541376,"data_stored":175414568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":785381829},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":591120,"kb_used_data":144896,"kb_used_omap":1,"kb_used_meta":446206,"kb_avail":93780720,"statfs":{"total":96636764160,"available":96031457280,"internally_reserved":0,"allocated":148373504,"data_stored":108711473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":456915397},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705781,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":808048,"kb_used_data":203548,"kb_used_omap":1,"kb_used_meta":604478,"kb_avail":93563792,"statfs":{"total":96636764160,"available":95809323008,"internally_reserved":0,"allocated":208433152,"data_stored":174159354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":618985925},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173895680,"data_stored":173879793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107810816,"data_stored":107809385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34041856,"data_stored":142889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36524032,"data_stored":167128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28823552,"data_stored":152768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32010240,"data_stored":170101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:29:36.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.722+0000 7fe30ea6f640 1 Processor -- start 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.722+0000 7fe30ea6f640 1 -- start start 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30ea6f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30809b3d0 0x7fe308141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30ea6f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe30813d340 0x7fe3081442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30ea6f640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3080a09a0 con 0x7fe30813c850 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30ea6f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe30809c2a0 con 0x7fe30813d340 2024-05-09T12:29:36.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30ea6f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe30809cdf0 con 0x7fe30809b3d0 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30d00c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe30813d340 0x7fe3081442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30c80b640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe30813c850 0x7fe30813cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:36528/0 (socket says 172.21.15.135:36528) 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe30c80b640 1 -- 172.21.15.135:0/3867055530 learned_addr learned my addr 172.21.15.135:0/3867055530 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.723+0000 7fe307fff640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30809b3d0 0x7fe308141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.724+0000 7fe30d00c640 1 -- 172.21.15.135:0/3867055530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30809b3d0 msgr2=0x7fe308141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.724+0000 7fe30d00c640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30809b3d0 0x7fe308141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.724+0000 7fe30d00c640 1 -- 172.21.15.135:0/3867055530 >> v1:172.21.15.160:6789/0 conn(0x7fe30813c850 legacy=0x7fe30813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.724+0000 7fe30d00c640 1 -- 172.21.15.135:0/3867055530 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30809b980 con 0x7fe30813d340 2024-05-09T12:29:36.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.725+0000 7fe30d00c640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081442d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe300009dc0 tx=0x7fe30002bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac747ab1747709e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.725+0000 7fe3077fe640 1 -- 172.21.15.135:0/3867055530 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30002d8f0 con 0x7fe30813d340 2024-05-09T12:29:36.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.725+0000 7fe3077fe640 1 -- 172.21.15.135:0/3867055530 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30002da90 con 0x7fe30813d340 2024-05-09T12:29:36.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.725+0000 7fe3077fe640 1 -- 172.21.15.135:0/3867055530 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30002de60 con 0x7fe30813d340 2024-05-09T12:29:36.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3867055530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 msgr2=0x7fe3081442d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081442d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe300009dc0 tx=0x7fe30002bbb0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3867055530 shutdown_connections 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081442d0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3867055530 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30809b3d0 0x7fe308141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3867055530 >> 172.21.15.135:0/3867055530 conn(0x7fe308075cf0 msgr2=0x7fe3080aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3867055530 shutdown_connections 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.726+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3867055530 wait complete. 2024-05-09T12:29:36.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.727+0000 7fe30ea6f640 1 Processor -- start 2024-05-09T12:29:36.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.727+0000 7fe30ea6f640 1 -- start start 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30813c850 0x7fe3081cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe30809aa20 con 0x7fe30813d340 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe30809bc70 con 0x7fe30809b3d0 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30ea6f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe30809c9a0 con 0x7fe30813c850 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30c80b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30c80b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41454/0 (socket says 172.21.15.135:41454) 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30c80b640 1 -- 172.21.15.135:0/3440375814 learned_addr learned my addr 172.21.15.135:0/3440375814 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe307fff640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30813c850 0x7fe3081cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.728+0000 7fe30d00c640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 -- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30813c850 msgr2=0x7fe3081cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30813c850 0x7fe3081cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 -- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 msgr2=0x7fe3081d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081d1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 -- 172.21.15.135:0/3440375814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3080a6c20 con 0x7fe30809b3d0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30c80b640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c730 tx=0x7fe2fc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc018070 con 0x7fe30809b3d0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0072d0 con 0x7fe30809b3d0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3080a7f80 con 0x7fe30809b3d0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0047e0 con 0x7fe30809b3d0 2024-05-09T12:29:36.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.729+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3080a8ca0 con 0x7fe30809b3d0 2024-05-09T12:29:36.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.731+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3080508d0 con 0x7fe30809b3d0 2024-05-09T12:29:36.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.732+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2fc01b070 con 0x7fe30809b3d0 2024-05-09T12:29:36.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.732+0000 7fe3057fa640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 0x7fe2f4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:36.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.732+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fe2fc0967d0 con 0x7fe30809b3d0 2024-05-09T12:29:36.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.733+0000 7fe307fff640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 0x7fe2f4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:36.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.733+0000 7fe307fff640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 0x7fe2f4078810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3080a8890 tx=0x7fe2f8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:36.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:36.740+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2fc060020 con 0x7fe30809b3d0 2024-05-09T12:29:37.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.115+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3081ce9b0 con 0x7fe30809b3d0 2024-05-09T12:29:37.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.116+0000 7fe3057fa640 1 -- 172.21.15.135:0/3440375814 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13826 (secure 0 0 0) 0x7fe2fc064320 con 0x7fe30809b3d0 2024-05-09T12:29:37.118 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:29:37.118 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":34,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:29:26.983468+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":51,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:0/1749211825":"2024-05-09T13:24:06.124315+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":48,"length":4}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":49,"length":1},{"begin":51,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:29:37.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 msgr2=0x7fe2f4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:37.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 0x7fe2f4078810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3080a8890 tx=0x7fe2f8009190 comp rx=0 tx=0).stop 2024-05-09T12:29:37.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 msgr2=0x7fe3081cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:37.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c730 tx=0x7fe2fc00cbf0 comp rx=0 tx=0).stop 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 shutdown_connections 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fe2f4076350 0x7fe2f4078810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30813d340 0x7fe3081d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe30813c850 0x7fe3081cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 --2- 172.21.15.135:0/3440375814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe30809b3d0 0x7fe3081cee30 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 >> 172.21.15.135:0/3440375814 conn(0x7fe308075cf0 msgr2=0x7fe30813a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 shutdown_connections 2024-05-09T12:29:37.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:37.120+0000 7fe30ea6f640 1 -- 172.21.15.135:0/3440375814 wait complete. 2024-05-09T12:29:38.137 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T12:29:38.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T12:29:38.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.286+0000 7fed96445640 1 Processor -- start 2024-05-09T12:29:38.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.286+0000 7fed96445640 1 -- start start 2024-05-09T12:29:38.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed96445640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fed9013f530 0x7fed90141920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed96445640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed90074a60 con 0x7fed9013ba20 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed8f7fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fed9013ba20 0x7fed9013de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42486/0 (socket says 172.21.15.135:42486) 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed96445640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed90071570 con 0x7fed90072500 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed8f7fe640 1 -- 172.21.15.135:0/257335002 learned_addr learned my addr 172.21.15.135:0/257335002 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fed90071d90 con 0x7fed9013f530 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.288+0000 7fed949e2640 1 --2- 172.21.15.135:0/257335002 >> v2:172.21.15.160:3300/0 conn(0x7fed9013f530 0x7fed90141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.287+0000 7fed8ffff640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fed90072500 0x7fed90135a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:36530/0 (socket says 172.21.15.135:36530) 2024-05-09T12:29:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.288+0000 7fed949e2640 1 -- 172.21.15.135:0/257335002 >> v1:172.21.15.160:6789/0 conn(0x7fed90072500 legacy=0x7fed90135a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.288+0000 7fed949e2640 1 -- 172.21.15.135:0/257335002 >> v1:172.21.15.135:6789/0 conn(0x7fed9013ba20 legacy=0x7fed9013de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.288+0000 7fed8effd640 1 -- 172.21.15.135:0/257335002 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595542462 0 0) 0x7fed90074a60 con 0x7fed9013ba20 2024-05-09T12:29:38.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.288+0000 7fed949e2640 1 -- 172.21.15.135:0/257335002 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90072bc0 con 0x7fed9013f530 2024-05-09T12:29:38.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.289+0000 7fed949e2640 1 --2- 172.21.15.135:0/257335002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013f530 0x7fed90141920 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fed80009d90 tx=0x7fed8002be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=102fa9229153ddba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.290+0000 7fed8effd640 1 -- 172.21.15.135:0/257335002 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80039070 con 0x7fed9013f530 2024-05-09T12:29:38.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.290+0000 7fed8effd640 1 -- 172.21.15.135:0/257335002 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8002cbe0 con 0x7fed9013f530 2024-05-09T12:29:38.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.290+0000 7fed8effd640 1 -- 172.21.15.135:0/257335002 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80034440 con 0x7fed9013f530 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013f530 msgr2=0x7fed90141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 --2- 172.21.15.135:0/257335002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013f530 0x7fed90141920 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fed80009d90 tx=0x7fed8002be30 comp rx=0 tx=0).stop 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 shutdown_connections 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 --2- 172.21.15.135:0/257335002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013f530 0x7fed90141920 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 >> 172.21.15.135:0/257335002 conn(0x7fed90075c20 msgr2=0x7fed900aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 shutdown_connections 2024-05-09T12:29:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.291+0000 7fed96445640 1 -- 172.21.15.135:0/257335002 wait complete. 2024-05-09T12:29:38.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.293+0000 7fed96445640 1 Processor -- start 2024-05-09T12:29:38.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.294+0000 7fed96445640 1 -- start start 2024-05-09T12:29:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed90072500 0x7fed901344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013ba20 0x7fed90134a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 0x7fed9009e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed90136140 con 0x7fed9013f530 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fed90070a80 con 0x7fed9013ba20 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed96445640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fed900728e0 con 0x7fed90072500 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed949e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 0x7fed9009e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed949e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 0x7fed9009e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37298/0 (socket says 172.21.15.135:37298) 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed949e2640 1 -- 172.21.15.135:0/1260699349 learned_addr learned my addr 172.21.15.135:0/1260699349 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed8f7fe640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013ba20 0x7fed90134a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.295+0000 7fed8ffff640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed90072500 0x7fed901344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 -- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013ba20 msgr2=0x7fed90134a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9013ba20 0x7fed90134a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 -- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 msgr2=0x7fed9009e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 0x7fed9009e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9009f550 con 0x7fed90072500 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed949e2640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed9013f530 0x7fed9009e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.296+0000 7fed8ffff640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed90072500 0x7fed901344e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c3c0 tx=0x7fed8800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.297+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed880074e0 con 0x7fed90072500 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.297+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88007680 con 0x7fed90072500 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.297+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed880049e0 con 0x7fed90072500 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.297+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed900a1950 con 0x7fed90072500 2024-05-09T12:29:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.297+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed900a05d0 con 0x7fed90072500 2024-05-09T12:29:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.298+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed9009f7f0 con 0x7fed90072500 2024-05-09T12:29:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.299+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed8801a020 con 0x7fed90072500 2024-05-09T12:29:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.300+0000 7fed8cff9640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fed7c076320 0x7fed7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.300+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fed880966a0 con 0x7fed90072500 2024-05-09T12:29:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.300+0000 7fed8cff9640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fed7c07e120 0x7fed7c0805a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.300+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed7c080c70 con 0x7fed7c07e120 2024-05-09T12:29:38.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.300+0000 7fed949e2640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fed7c07e120 0x7fed7c0805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.301+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed8805c590 con 0x7fed90072500 2024-05-09T12:29:38.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.301+0000 7fed949e2640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fed7c07e120 0x7fed7c0805a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.301+0000 7fed8f7fe640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fed7c076320 0x7fed7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.302+0000 7fed8f7fe640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fed7c076320 0x7fed7c0787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed9009f280 tx=0x7fed84010040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.302+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== osd.0 v2:172.21.15.135:6800/3069336338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed7c080c70 con 0x7fed7c07e120 2024-05-09T12:29:38.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 --> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed9006a470 con 0x7fed7c07e120 2024-05-09T12:29:38.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed8cff9640 1 -- 172.21.15.135:0/1260699349 <== osd.0 v2:172.21.15.135:6800/3069336338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed9006a470 con 0x7fed7c07e120 2024-05-09T12:29:38.329 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-09T12:29:38.329 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T12:29:38.330 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-09T12:29:38.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fed7c07e120 msgr2=0x7fed7c0805a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed96445640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6800/3069336338,v1:172.21.15.135:6801/3069336338] conn(0x7fed7c07e120 0x7fed7c0805a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fed7c076320 msgr2=0x7fed7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.328+0000 7fed96445640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fed7c076320 0x7fed7c0787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed9009f280 tx=0x7fed84010040 comp rx=0 tx=0).stop 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed90072500 msgr2=0x7fed901344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 --2- 172.21.15.135:0/1260699349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed90072500 0x7fed901344e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c3c0 tx=0x7fed8800c880 comp rx=0 tx=0).stop 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed949e2640 1 -- 172.21.15.135:0/1260699349 reap_dead start 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 shutdown_connections 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 >> 172.21.15.135:0/1260699349 conn(0x7fed90075c20 msgr2=0x7fed90138520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 shutdown_connections 2024-05-09T12:29:38.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.329+0000 7fed96445640 1 -- 172.21.15.135:0/1260699349 wait complete. 2024-05-09T12:29:38.346 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T12:29:38.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.492+0000 7f4cd08d4640 1 Processor -- start 2024-05-09T12:29:38.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 -- start start 2024-05-09T12:29:38.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ccc13d9a0 0x7f4ccc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 0x7f4ccc1426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc070680 con 0x7f4ccc13ac50 2024-05-09T12:29:38.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc071260 con 0x7f4ccc1402d0 2024-05-09T12:29:38.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.494+0000 7f4cd08d4640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc0a7740 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cc3fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4ccc13d9a0 0x7f4ccc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cca59c640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f4ccc13ac50 0x7f4ccc13b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:36534/0 (socket says 172.21.15.135:36534) 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cca59c640 1 -- 172.21.15.135:0/1312732189 learned_addr learned my addr 172.21.15.135:0/1312732189 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4ccad9d640 1 --2- 172.21.15.135:0/1312732189 >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 0x7f4ccc1426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cc3fff640 1 -- 172.21.15.135:0/1312732189 >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 msgr2=0x7f4ccc1426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cc9d9b640 1 -- 172.21.15.135:0/1312732189 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230694215 0 0) 0x7f4ccc070680 con 0x7f4ccc13ac50 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cc3fff640 1 --2- 172.21.15.135:0/1312732189 >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 0x7f4ccc1426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.495+0000 7f4cc3fff640 1 -- 172.21.15.135:0/1312732189 >> v1:172.21.15.160:6789/0 conn(0x7f4ccc13ac50 legacy=0x7f4ccc13b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.496+0000 7f4cc3fff640 1 -- 172.21.15.135:0/1312732189 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc0a7120 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.496+0000 7f4ccad9d640 1 --2- 172.21.15.135:0/1312732189 >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 0x7f4ccc1426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:29:38.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.497+0000 7f4cc3fff640 1 --2- 172.21.15.135:0/1312732189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13d9a0 0x7f4ccc13fd90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0a1f40 tx=0x7f4cb402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba0dec71e8077afd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.497+0000 7f4cc9d9b640 1 -- 172.21.15.135:0/1312732189 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40315a0 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.498+0000 7f4cc9d9b640 1 -- 172.21.15.135:0/1312732189 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4037070 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.498+0000 7f4cc9d9b640 1 -- 172.21.15.135:0/1312732189 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4031960 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1312732189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13d9a0 msgr2=0x7f4ccc13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1312732189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13d9a0 0x7f4ccc13fd90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0a1f40 tx=0x7f4cb402b840 comp rx=0 tx=0).stop 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1312732189 shutdown_connections 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1312732189 >> v2:172.21.15.135:3300/0 conn(0x7f4ccc1402d0 0x7f4ccc1426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1312732189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13d9a0 0x7f4ccc13fd90 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.499+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1312732189 >> 172.21.15.135:0/1312732189 conn(0x7f4ccc0aaf90 msgr2=0x7f4ccc0ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:38.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.500+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1312732189 shutdown_connections 2024-05-09T12:29:38.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.500+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1312732189 wait complete. 2024-05-09T12:29:38.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.501+0000 7f4cd08d4640 1 Processor -- start 2024-05-09T12:29:38.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.501+0000 7f4cd08d4640 1 -- start start 2024-05-09T12:29:38.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 0x7f4ccc131c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ccc13d9a0 0x7f4ccc132170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0700e0 con 0x7f4ccc1402d0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0a6dc0 con 0x7f4ccc13ac50 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.502+0000 7f4cd08d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc0703a0 con 0x7f4ccc13d9a0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37320/0 (socket says 172.21.15.135:37320) 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 -- 172.21.15.135:0/1771004759 learned_addr learned my addr 172.21.15.135:0/1771004759 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4cca59c640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 0x7f4ccc131c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 -- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ccc13d9a0 msgr2=0x7f4ccc132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4cc3fff640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ccc13d9a0 0x7f4ccc132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ccc13d9a0 0x7f4ccc132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 -- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 msgr2=0x7f4ccc131c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 0x7f4ccc131c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4ccad9d640 1 -- 172.21.15.135:0/1771004759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc13d260 con 0x7f4ccc1402d0 2024-05-09T12:29:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.503+0000 7f4cca59c640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 0x7f4ccc131c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.504+0000 7f4ccad9d640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400efb0 tx=0x7f4cc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.504+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4018020 con 0x7f4ccc1402d0 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.504+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc13de20 con 0x7f4ccc1402d0 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.505+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc13e7a0 con 0x7f4ccc1402d0 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.505+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4014480 con 0x7f4ccc1402d0 2024-05-09T12:29:38.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.505+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4014830 con 0x7f4ccc1402d0 2024-05-09T12:29:38.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.506+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb0005080 con 0x7f4ccc1402d0 2024-05-09T12:29:38.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.508+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cc4005d10 con 0x7f4ccc1402d0 2024-05-09T12:29:38.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.508+0000 7f4cc2ffd640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 0x7f4cac078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:38.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.508+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f4cc4097e60 con 0x7f4ccc1402d0 2024-05-09T12:29:38.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.509+0000 7f4cca59c640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 0x7f4cac078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:38.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.509+0000 7f4cca59c640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 0x7f4cac078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000f60 tx=0x7f4cbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:38.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.515+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4cc4022030 con 0x7f4ccc1402d0 2024-05-09T12:29:38.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.892+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4cb0000bc0 con 0x7f4cac0763a0 2024-05-09T12:29:38.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.892+0000 7f4cc2ffd640 1 -- 172.21.15.135:0/1771004759 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4cb0000bc0 con 0x7f4cac0763a0 2024-05-09T12:29:38.894 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T12:29:38.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 msgr2=0x7f4cac078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 0x7f4cac078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000f60 tx=0x7f4cbc009040 comp rx=0 tx=0).stop 2024-05-09T12:29:38.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 msgr2=0x7f4ccc132900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400efb0 tx=0x7f4cc400c490 comp rx=0 tx=0).stop 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 shutdown_connections 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f4cac0763a0 0x7f4cac078860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ccc1402d0 0x7f4ccc132900 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ccc13d9a0 0x7f4ccc132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 --2- 172.21.15.135:0/1771004759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ccc13ac50 0x7f4ccc131c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 >> 172.21.15.135:0/1771004759 conn(0x7f4ccc0aaf90 msgr2=0x7f4ccc139300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.896+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 shutdown_connections 2024-05-09T12:29:38.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:38.897+0000 7f4cd08d4640 1 -- 172.21.15.135:0/1771004759 wait complete. 2024-05-09T12:29:38.915 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T12:29:38.915 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T12:29:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.072+0000 7fb920177640 1 Processor -- start 2024-05-09T12:29:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.073+0000 7fb920177640 1 -- start start 2024-05-09T12:29:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb920177640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb918136620 0x7fb918136a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb91df13640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb918136620 0x7fb918136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb91df13640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb918136620 0x7fb918136a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37322/0 (socket says 172.21.15.135:37322) 2024-05-09T12:29:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb91df13640 1 -- 172.21.15.135:0/1003503279 learned_addr learned my addr 172.21.15.135:0/1003503279 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb920177640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb9181398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.074+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb918071a90 con 0x7fb918139e00 2024-05-09T12:29:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.075+0000 7fb91d712640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb9181398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.075+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb9180711c0 con 0x7fb918136620 2024-05-09T12:29:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.075+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb918136f40 con 0x7fb918139460 2024-05-09T12:29:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.076+0000 7fb91df13640 1 -- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 msgr2=0x7fb9181398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.076+0000 7fb91df13640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb9181398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.076+0000 7fb91df13640 1 -- 172.21.15.135:0/1003503279 >> v1:172.21.15.135:6789/0 conn(0x7fb918139e00 legacy=0x7fb918140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.076+0000 7fb91df13640 1 -- 172.21.15.135:0/1003503279 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180713e0 con 0x7fb918136620 2024-05-09T12:29:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.077+0000 7fb91d712640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb9181398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:29:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.077+0000 7fb91df13640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb918136a00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fb9140098a0 tx=0x7fb91402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b9114c455c925b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.078+0000 7fb91cf11640 1 -- 172.21.15.135:0/1003503279 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914035020 con 0x7fb918136620 2024-05-09T12:29:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.078+0000 7fb91cf11640 1 -- 172.21.15.135:0/1003503279 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914031800 con 0x7fb918136620 2024-05-09T12:29:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.078+0000 7fb91cf11640 1 -- 172.21.15.135:0/1003503279 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914031c10 con 0x7fb918136620 2024-05-09T12:29:39.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 msgr2=0x7fb918136a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb918136a00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fb9140098a0 tx=0x7fb91402b8a0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 shutdown_connections 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb9181398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 --2- 172.21.15.135:0/1003503279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb918136a00 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.079+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 >> 172.21.15.135:0/1003503279 conn(0x7fb9180ab9b0 msgr2=0x7fb9180abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.080+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 shutdown_connections 2024-05-09T12:29:39.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.080+0000 7fb920177640 1 -- 172.21.15.135:0/1003503279 wait complete. 2024-05-09T12:29:39.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.081+0000 7fb920177640 1 Processor -- start 2024-05-09T12:29:39.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.081+0000 7fb920177640 1 -- start start 2024-05-09T12:29:39.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.081+0000 7fb920177640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb91806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb920177640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb91806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb920177640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb918139e00 0x7fb91806cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91df13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb91806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91df13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb91806c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37328/0 (socket says 172.21.15.135:37328) 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91df13640 1 -- 172.21.15.135:0/3547899447 learned_addr learned my addr 172.21.15.135:0/3547899447 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb920177640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb91809dc00 con 0x7fb918136620 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb920177640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb918070a30 con 0x7fb918139e00 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb920177640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb91813a230 con 0x7fb918139460 2024-05-09T12:29:39.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91e714640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb918139e00 0x7fb91806cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91d712640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb91806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91df13640 1 -- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 msgr2=0x7fb91806c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.082+0000 7fb91df13640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb918139460 0x7fb91806c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.083+0000 7fb91df13640 1 -- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb918139e00 msgr2=0x7fb91806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.083+0000 7fb91df13640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb918139e00 0x7fb91806cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.083+0000 7fb91df13640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180a4640 con 0x7fb918136620 2024-05-09T12:29:39.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.083+0000 7fb91df13640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb91806c0d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fb9140098a0 tx=0x7fb9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.084+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914044070 con 0x7fb918136620 2024-05-09T12:29:39.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.084+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914039b70 con 0x7fb918136620 2024-05-09T12:29:39.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.084+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914035040 con 0x7fb918136620 2024-05-09T12:29:39.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.084+0000 7fb920177640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9180a34c0 con 0x7fb918136620 2024-05-09T12:29:39.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.085+0000 7fb920177640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9180a1770 con 0x7fb918136620 2024-05-09T12:29:39.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.086+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8f4000f80 con 0x7fb918136620 2024-05-09T12:29:39.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.088+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb91404f060 con 0x7fb918136620 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.088+0000 7fb90e7fc640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb8fc0763a0 0x7fb8fc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.088+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fb9140bce50 con 0x7fb918136620 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.088+0000 7fb90e7fc640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fb8fc07e220 0x7fb8fc0806a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.089+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb914052e50 con 0x7fb8fc07e220 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.089+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb9140bf4b0 con 0x7fb918136620 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.089+0000 7fb91d712640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb8fc0763a0 0x7fb8fc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.089+0000 7fb91e714640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fb8fc07e220 0x7fb8fc0806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.090+0000 7fb91d712640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb8fc0763a0 0x7fb8fc078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9180a33f0 tx=0x7fb908008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.090+0000 7fb91e714640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fb8fc07e220 0x7fb8fc0806a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.091+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== osd.1 v2:172.21.15.135:6808/290955535 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb914052e50 con 0x7fb8fc07e220 2024-05-09T12:29:39.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.113+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 --> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8f4002cd0 con 0x7fb8fc07e220 2024-05-09T12:29:39.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.113+0000 7fb90e7fc640 1 -- 172.21.15.135:0/3547899447 <== osd.1 v2:172.21.15.135:6808/290955535 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8f4002cd0 con 0x7fb8fc07e220 2024-05-09T12:29:39.114 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-09T12:29:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T12:29:39.115 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-09T12:29:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.113+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fb8fc07e220 msgr2=0x7fb8fc0806a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.113+0000 7fb8fbfff640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6808/290955535,v1:172.21.15.135:6809/290955535] conn(0x7fb8fc07e220 0x7fb8fc0806a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb8fc0763a0 msgr2=0x7fb8fc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb8fc0763a0 0x7fb8fc078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9180a33f0 tx=0x7fb908008040 comp rx=0 tx=0).stop 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 msgr2=0x7fb91806c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 --2- 172.21.15.135:0/3547899447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918136620 0x7fb91806c0d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fb9140098a0 tx=0x7fb9140046c0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb91e714640 1 -- 172.21.15.135:0/3547899447 reap_dead start 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 shutdown_connections 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 >> 172.21.15.135:0/3547899447 conn(0x7fb9180ab9b0 msgr2=0x7fb918137360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 shutdown_connections 2024-05-09T12:29:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.114+0000 7fb8fbfff640 1 -- 172.21.15.135:0/3547899447 wait complete. 2024-05-09T12:29:39.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T12:29:39.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.277+0000 7fa1234c3640 1 Processor -- start 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.277+0000 7fa1234c3640 1 -- start start 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa1234c3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 0x7fa11c13ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa1234c3640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa11c06cd00 0x7fa11c0a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa1234c3640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa11c09ca90 con 0x7fa11c09e0f0 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa1234c3640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa11c09d2f0 con 0x7fa11c13a790 2024-05-09T12:29:39.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa1234c3640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fa11c09be50 con 0x7fa11c06cd00 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.278+0000 7fa12125f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 0x7fa11c13ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa12125f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 0x7fa11c13ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37332/0 (socket says 172.21.15.135:37332) 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa12125f640 1 -- 172.21.15.135:0/355066265 learned_addr learned my addr 172.21.15.135:0/355066265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa120a5e640 1 --2- 172.21.15.135:0/355066265 >> v2:172.21.15.160:3300/0 conn(0x7fa11c06cd00 0x7fa11c0a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa120a5e640 1 -- 172.21.15.135:0/355066265 >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 msgr2=0x7fa11c13ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:39.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa120a5e640 1 --2- 172.21.15.135:0/355066265 >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 0x7fa11c13ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa120a5e640 1 -- 172.21.15.135:0/355066265 >> v1:172.21.15.160:6789/0 conn(0x7fa11c09e0f0 legacy=0x7fa11c0a8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.279+0000 7fa120a5e640 1 -- 172.21.15.135:0/355066265 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c09c110 con 0x7fa11c06cd00 2024-05-09T12:29:39.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.280+0000 7fa120a5e640 1 --2- 172.21.15.135:0/355066265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c06cd00 0x7fa11c0a7b00 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa11c06fd10 tx=0x7fa10c02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8d3571e12e3ec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.281+0000 7fa113fff640 1 -- 172.21.15.135:0/355066265 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c038070 con 0x7fa11c06cd00 2024-05-09T12:29:39.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.281+0000 7fa113fff640 1 -- 172.21.15.135:0/355066265 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c031710 con 0x7fa11c06cd00 2024-05-09T12:29:39.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa113fff640 1 -- 172.21.15.135:0/355066265 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c031ae0 con 0x7fa11c06cd00 2024-05-09T12:29:39.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 -- 172.21.15.135:0/355066265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c06cd00 msgr2=0x7fa11c0a7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 --2- 172.21.15.135:0/355066265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c06cd00 0x7fa11c0a7b00 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa11c06fd10 tx=0x7fa10c02b7b0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 -- 172.21.15.135:0/355066265 shutdown_connections 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 --2- 172.21.15.135:0/355066265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c06cd00 0x7fa11c0a7b00 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 --2- 172.21.15.135:0/355066265 >> v2:172.21.15.135:3300/0 conn(0x7fa11c13a790 0x7fa11c13ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 -- 172.21.15.135:0/355066265 >> 172.21.15.135:0/355066265 conn(0x7fa11c0abcd0 msgr2=0x7fa11c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.282+0000 7fa1234c3640 1 -- 172.21.15.135:0/355066265 shutdown_connections 2024-05-09T12:29:39.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.283+0000 7fa1234c3640 1 -- 172.21.15.135:0/355066265 wait complete. 2024-05-09T12:29:39.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.284+0000 7fa1234c3640 1 Processor -- start 2024-05-09T12:29:39.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.284+0000 7fa1234c3640 1 -- start start 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa1234c3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa1234c3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 0x7fa11c1d3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa1234c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa120a5e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 0x7fa11c1d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa120a5e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 0x7fa11c1d3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41486/0 (socket says 172.21.15.135:41486) 2024-05-09T12:29:39.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa12125f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa121a60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa12125f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57354/0 (socket says 172.21.15.135:57354) 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa121a60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37334/0 (socket says 172.21.15.135:37334) 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa120a5e640 1 -- 172.21.15.135:0/2264954022 learned_addr learned my addr 172.21.15.135:0/2264954022 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c09dc00 con 0x7fa11c0729a0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.285+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c09da80 con 0x7fa11c13a790 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c0a8750 con 0x7fa11c09e0f0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 -- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 msgr2=0x7fa11c1d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 -- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 msgr2=0x7fa11c1d3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 0x7fa11c1d3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c071970 con 0x7fa11c0729a0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa12125f640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa121a60640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c3c0 tx=0x7fa11800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118017070 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.286+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c13b2e0 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.287+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1180052d0 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.287+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118003830 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.287+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c071fc0 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.288+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c09ea40 con 0x7fa11c0729a0 2024-05-09T12:29:39.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.290+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa11801a070 con 0x7fa11c0729a0 2024-05-09T12:29:39.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.290+0000 7fa111ffb640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 0x7fa1000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.291+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fa1180963f0 con 0x7fa11c0729a0 2024-05-09T12:29:39.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.292+0000 7fa12125f640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 0x7fa1000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.292+0000 7fa12125f640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 0x7fa1000787c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa11c071c30 tx=0x7fa11400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.297+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa11c09ea40 con 0x7fa11c0729a0 2024-05-09T12:29:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.624+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa11c071c60 con 0x7fa100076300 2024-05-09T12:29:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.624+0000 7fa111ffb640 1 -- 172.21.15.135:0/2264954022 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa11c071c60 con 0x7fa100076300 2024-05-09T12:29:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T12:29:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.627+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 msgr2=0x7fa1000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.627+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 0x7fa1000787c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa11c071c30 tx=0x7fa11400b040 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.627+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 msgr2=0x7fa11c1d62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.627+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c3c0 tx=0x7fa11800c7c0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 shutdown_connections 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa100076300 0x7fa1000787c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa11c0729a0 0x7fa11c1d62a0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa11c13a790 0x7fa11c1d3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 --2- 172.21.15.135:0/2264954022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa11c09e0f0 0x7fa11c1d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 >> 172.21.15.135:0/2264954022 conn(0x7fa11c0abcd0 msgr2=0x7fa11c13d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 shutdown_connections 2024-05-09T12:29:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.628+0000 7fa1234c3640 1 -- 172.21.15.135:0/2264954022 wait complete. 2024-05-09T12:29:39.644 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T12:29:39.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T12:29:39.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.795+0000 7f04409ed640 1 Processor -- start 2024-05-09T12:29:39.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.795+0000 7f04409ed640 1 -- start start 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f04409ed640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f043c074070 0x7f043c13e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f04409ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f04409ed640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c071430 con 0x7f043c073580 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f04409ed640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f043c071900 con 0x7f043c074070 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f04409ed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f043c09dab0 con 0x7f043c13eda0 2024-05-09T12:29:39.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f043c074070 0x7f043c13e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f043ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f043c074070 0x7f043c13e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41492/0 (socket says 172.21.15.135:41492) 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f043ad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57364/0 (socket says 172.21.15.135:57364) 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 -- 172.21.15.135:0/3677969673 learned_addr learned my addr 172.21.15.135:0/3677969673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 -- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 msgr2=0x7f043c141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:39.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 -- 172.21.15.135:0/3677969673 >> v1:172.21.15.135:6789/0 conn(0x7f043c073580 legacy=0x7f043c073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.796+0000 7f0439d9b640 1 -- 172.21.15.135:0/3677969673 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c071b50 con 0x7f043c074070 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.797+0000 7f043ad9d640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.797+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c074070 0x7f043c13e860 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0430009870 tx=0x7f043002da70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a21d607fe952b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.798+0000 7f043959a640 1 -- 172.21.15.135:0/3677969673 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043002f830 con 0x7f043c074070 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.798+0000 7f043959a640 1 -- 172.21.15.135:0/3677969673 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043002f9d0 con 0x7f043c074070 2024-05-09T12:29:39.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.798+0000 7f043959a640 1 -- 172.21.15.135:0/3677969673 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043002fda0 con 0x7f043c074070 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 -- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c074070 msgr2=0x7f043c13e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c074070 0x7f043c13e860 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0430009870 tx=0x7f043002da70 comp rx=0 tx=0).stop 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 -- 172.21.15.135:0/3677969673 shutdown_connections 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c13eda0 0x7f043c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 --2- 172.21.15.135:0/3677969673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c074070 0x7f043c13e860 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 -- 172.21.15.135:0/3677969673 >> 172.21.15.135:0/3677969673 conn(0x7f043c0abcd0 msgr2=0x7f043c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 -- 172.21.15.135:0/3677969673 shutdown_connections 2024-05-09T12:29:39.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.799+0000 7f04409ed640 1 -- 172.21.15.135:0/3677969673 wait complete. 2024-05-09T12:29:39.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.801+0000 7f04409ed640 1 Processor -- start 2024-05-09T12:29:39.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.801+0000 7f04409ed640 1 -- start start 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 0x7f043c1ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c074070 0x7f043c1caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c13eda0 0x7f043c1cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f043c0725c0 con 0x7f043c074070 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f043c070f90 con 0x7f043c13eda0 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f04409ed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f043c072740 con 0x7f043c073580 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 0x7f043c1ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 0x7f043c1ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57380/0 (socket says 172.21.15.135:57380) 2024-05-09T12:29:39.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 -- 172.21.15.135:0/3749256117 learned_addr learned my addr 172.21.15.135:0/3749256117 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c074070 0x7f043c1caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043ad9d640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c13eda0 0x7f043c1cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 -- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c13eda0 msgr2=0x7f043c1cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c13eda0 0x7f043c1cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 -- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c074070 msgr2=0x7f043c1caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c074070 0x7f043c1caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043a59c640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c1ca170 con 0x7f043c073580 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f043c074070 0x7f043c1caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.802+0000 7f043ad9d640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f043c13eda0 0x7f043c1cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f043a59c640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 0x7f043c1ca580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c500 tx=0x7f042c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0052d0 con 0x7f043c073580 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c005470 con 0x7f043c073580 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c012870 con 0x7f043c073580 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f04409ed640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c0a0ab0 con 0x7f043c073580 2024-05-09T12:29:39.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.803+0000 7f04409ed640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c0a1440 con 0x7f043c073580 2024-05-09T12:29:39.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.805+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f043c0a28a0 con 0x7f043c073580 2024-05-09T12:29:39.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.806+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f042c012a10 con 0x7f043c073580 2024-05-09T12:29:39.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f042affd640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f041c0762d0 0x7f041c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f041c0762d0 0x7f041c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f042c096e80 con 0x7f043c073580 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f042affd640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7f041c07e040 0x7f041c0804c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f042c004ec0 con 0x7f041c07e040 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f042c05c3e0 con 0x7f043c073580 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.807+0000 7f043ad9d640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7f041c07e040 0x7f041c0804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.808+0000 7f0439d9b640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f041c0762d0 0x7f041c078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0430038000 tx=0x7f0430008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.808+0000 7f043ad9d640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7f041c07e040 0x7f041c0804c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:39.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.809+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== osd.2 v2:172.21.15.160:6800/2987975206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f042c004ec0 con 0x7f041c07e040 2024-05-09T12:29:39.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.834+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 --> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f043c1cb000 con 0x7f041c07e040 2024-05-09T12:29:39.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.835+0000 7f042affd640 1 -- 172.21.15.135:0/3749256117 <== osd.2 v2:172.21.15.160:6800/2987975206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0434007450 con 0x7f041c07e040 2024-05-09T12:29:39.836 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-09T12:29:39.836 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T12:29:39.836 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-09T12:29:39.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.835+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7f041c07e040 msgr2=0x7f041c0804c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.835+0000 7f0428ff9640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:6800/2987975206,v1:172.21.15.160:6801/2987975206] conn(0x7f041c07e040 0x7f041c0804c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f041c0762d0 msgr2=0x7f041c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f041c0762d0 0x7f041c078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0430038000 tx=0x7f0430008030 comp rx=0 tx=0).stop 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 msgr2=0x7f043c1ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 --2- 172.21.15.135:0/3749256117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f043c073580 0x7f043c1ca580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c500 tx=0x7f042c00c9c0 comp rx=0 tx=0).stop 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f043ad9d640 1 -- 172.21.15.135:0/3749256117 reap_dead start 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 shutdown_connections 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.836+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 >> 172.21.15.135:0/3749256117 conn(0x7f043c0abcd0 msgr2=0x7f043c1352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:39.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.837+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 shutdown_connections 2024-05-09T12:29:39.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.837+0000 7f0428ff9640 1 -- 172.21.15.135:0/3749256117 wait complete. 2024-05-09T12:29:39.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T12:29:40.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.999+0000 7f3d27769640 1 Processor -- start 2024-05-09T12:29:40.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:39.999+0000 7f3d27769640 1 -- start start 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d27769640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d2013e3a0 0x7f3d201411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d27769640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d200719a0 con 0x7f3d201416e0 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d27769640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d20071c80 con 0x7f3d2013dfc0 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d27769640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f3d20070370 con 0x7f3d2013e3a0 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d2013e3a0 0x7f3d201411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d2013e3a0 0x7f3d201411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41522/0 (socket says 172.21.15.135:41522) 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 -- 172.21.15.135:0/691476136 learned_addr learned my addr 172.21.15.135:0/691476136 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 -- 172.21.15.135:0/691476136 >> v1:172.21.15.160:6789/0 conn(0x7f3d2013dfc0 legacy=0x7f3d20140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 -- 172.21.15.135:0/691476136 >> v1:172.21.15.135:6789/0 conn(0x7f3d201416e0 legacy=0x7f3d20148e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T12:29:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.000+0000 7f3d24d04640 1 -- 172.21.15.135:0/691476136 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d20071280 con 0x7f3d2013e3a0 2024-05-09T12:29:40.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.001+0000 7f3d24d04640 1 --2- 172.21.15.135:0/691476136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d2013e3a0 0x7f3d201411a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009870 tx=0x7f3d1002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f8e4b4aefe339a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.002+0000 7f3d17fff640 1 -- 172.21.15.135:0/691476136 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100317c0 con 0x7f3d2013e3a0 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.002+0000 7f3d17fff640 1 -- 172.21.15.135:0/691476136 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10037070 con 0x7f3d2013e3a0 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.002+0000 7f3d17fff640 1 -- 172.21.15.135:0/691476136 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10031b80 con 0x7f3d2013e3a0 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 -- 172.21.15.135:0/691476136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d2013e3a0 msgr2=0x7f3d201411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 --2- 172.21.15.135:0/691476136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d2013e3a0 0x7f3d201411a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009870 tx=0x7f3d1002b860 comp rx=0 tx=0).stop 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 -- 172.21.15.135:0/691476136 shutdown_connections 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 --2- 172.21.15.135:0/691476136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d2013e3a0 0x7f3d201411a0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 -- 172.21.15.135:0/691476136 >> 172.21.15.135:0/691476136 conn(0x7f3d200aa930 msgr2=0x7f3d200aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:40.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 -- 172.21.15.135:0/691476136 shutdown_connections 2024-05-09T12:29:40.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.003+0000 7f3d27769640 1 -- 172.21.15.135:0/691476136 wait complete. 2024-05-09T12:29:40.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.004+0000 7f3d27769640 1 Processor -- start 2024-05-09T12:29:40.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.004+0000 7f3d27769640 1 -- start start 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 0x7f3d2013a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d201416e0 0x7f3d2013b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20072860 con 0x7f3d2013e3a0 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20070d90 con 0x7f3d201416e0 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d27769640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3d20073fa0 con 0x7f3d2013dfc0 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d24d04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d24d04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37344/0 (socket says 172.21.15.135:37344) 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d24d04640 1 -- 172.21.15.135:0/2048660973 learned_addr learned my addr 172.21.15.135:0/2048660973 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d25505640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 0x7f3d2013a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.005+0000 7f3d25d06640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d201416e0 0x7f3d2013b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 -- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d201416e0 msgr2=0x7f3d2013b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d201416e0 0x7f3d2013b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 -- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 msgr2=0x7f3d2013ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 -- 172.21.15.135:0/2048660973 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d200a4e60 con 0x7f3d2013dfc0 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d24d04640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d25505640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 0x7f3d2013a8a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c430 tx=0x7f3d1c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c017070 con 0x7f3d2013dfc0 2024-05-09T12:29:40.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1c0052d0 con 0x7f3d2013dfc0 2024-05-09T12:29:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c003810 con 0x7f3d2013dfc0 2024-05-09T12:29:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d200a58f0 con 0x7f3d2013dfc0 2024-05-09T12:29:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.006+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d200a5420 con 0x7f3d2013dfc0 2024-05-09T12:29:40.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.008+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d200a3bc0 con 0x7f3d2013dfc0 2024-05-09T12:29:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.009+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d1c01a070 con 0x7f3d2013dfc0 2024-05-09T12:29:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.009+0000 7f3d15ffb640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 0x7f3d04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.009+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f3d1c096430 con 0x7f3d2013dfc0 2024-05-09T12:29:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.009+0000 7f3d24d04640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 0x7f3d04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.010+0000 7f3d24d04640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 0x7f3d04078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d200725f0 tx=0x7f3d1003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.015+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d200a3bc0 con 0x7f3d2013dfc0 2024-05-09T12:29:40.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.330+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f3d200508d0 con 0x7f3d040762d0 2024-05-09T12:29:40.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.331+0000 7f3d15ffb640 1 -- 172.21.15.135:0/2048660973 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d200508d0 con 0x7f3d040762d0 2024-05-09T12:29:40.332 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T12:29:40.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 msgr2=0x7f3d04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 0x7f3d04078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d200725f0 tx=0x7f3d1003d040 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 msgr2=0x7f3d2013a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 0x7f3d2013a8a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c430 tx=0x7f3d1c00c8f0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 shutdown_connections 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3d040762d0 0x7f3d04078790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d201416e0 0x7f3d2013b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d2013e3a0 0x7f3d2013ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 --2- 172.21.15.135:0/2048660973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d2013dfc0 0x7f3d2013a8a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 >> 172.21.15.135:0/2048660973 conn(0x7f3d200aa930 msgr2=0x7f3d20140fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 shutdown_connections 2024-05-09T12:29:40.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.334+0000 7f3d27769640 1 -- 172.21.15.135:0/2048660973 wait complete. 2024-05-09T12:29:40.350 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T12:29:40.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T12:29:40.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.508+0000 7effa36bc640 1 Processor -- start 2024-05-09T12:29:40.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.508+0000 7effa36bc640 1 -- start start 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.509+0000 7effa36bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff9c0a51b0 0x7eff9c13dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa36bc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9c133450 con 0x7eff9c13e510 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa36bc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9c0a2c40 con 0x7eff9c132960 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa36bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c0a3300 con 0x7eff9c0a51b0 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa0c57640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff9c0a51b0 0x7eff9c13dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa0c57640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff9c0a51b0 0x7eff9c13dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57400/0 (socket says 172.21.15.135:57400) 2024-05-09T12:29:40.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.510+0000 7effa0c57640 1 -- 172.21.15.135:0/3414274202 learned_addr learned my addr 172.21.15.135:0/3414274202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:40.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 818343736 0 0) 0x7eff9c133450 con 0x7eff9c13e510 2024-05-09T12:29:40.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff88003520 con 0x7eff9c13e510 2024-05-09T12:29:40.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2313503941 0 0) 0x7eff88003520 con 0x7eff9c13e510 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff9c0a51b0 msgr2=0x7eff9c13dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff9c0a51b0 0x7eff9c13dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 >> v1:172.21.15.160:6789/0 conn(0x7eff9c132960 legacy=0x7eff9c132d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.511+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c0a74b0 con 0x7eff9c13e510 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7eff94001a70 con 0x7eff9c13e510 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 >> v1:172.21.15.135:6789/0 conn(0x7eff9c13e510 legacy=0x7eff9c140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88003a30 0x7eff88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff88004800 0x7eff88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c0a3300 con 0x7eff88003a30 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7effa1c59640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7effa1458640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88003a30 0x7eff88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7eff8800c250 con 0x7eff88004800 2024-05-09T12:29:40.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.512+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7eff8800c450 con 0x7eff880053f0 2024-05-09T12:29:40.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa0c57640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff88004800 0x7eff88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa1c59640 1 -- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff88004800 msgr2=0x7eff88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:40.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa1c59640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff88004800 0x7eff88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa1c59640 1 -- 172.21.15.135:0/3414274202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88003a30 msgr2=0x7eff88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa1c59640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88003a30 0x7eff88003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.513+0000 7effa1c59640 1 -- 172.21.15.135:0/3414274202 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88003520 con 0x7eff880053f0 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.514+0000 7effa1c59640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff8800b9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c510 tx=0x7eff88005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7068609be7ca5d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.514+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94039070 con 0x7eff880053f0 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.514+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9402ccb0 con 0x7eff880053f0 2024-05-09T12:29:40.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.514+0000 7eff93fff640 1 -- 172.21.15.135:0/3414274202 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9400c0e0 con 0x7eff880053f0 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.515+0000 7effa36bc640 1 -- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 msgr2=0x7eff8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.515+0000 7effa36bc640 1 --2- 172.21.15.135:0/3414274202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff8800b9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c510 tx=0x7eff88005830 comp rx=0 tx=0).stop 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.515+0000 7effa1c59640 1 -- 172.21.15.135:0/3414274202 reap_dead start 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.516+0000 7effa36bc640 1 -- 172.21.15.135:0/3414274202 shutdown_connections 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.516+0000 7effa36bc640 1 -- 172.21.15.135:0/3414274202 >> 172.21.15.135:0/3414274202 conn(0x7eff9c0aaeb0 msgr2=0x7eff9c0ab2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:40.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.516+0000 7effa36bc640 1 -- 172.21.15.135:0/3414274202 shutdown_connections 2024-05-09T12:29:40.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.517+0000 7effa36bc640 1 -- 172.21.15.135:0/3414274202 wait complete. 2024-05-09T12:29:40.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.519+0000 7effa36bc640 1 Processor -- start 2024-05-09T12:29:40.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.519+0000 7effa36bc640 1 -- start start 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.519+0000 7effa36bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff9c1cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.519+0000 7effa36bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9c0a9e30 0x7eff9c1ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa36bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c0a8cb0 0x7eff9c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa1458640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff9c1cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa1458640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff9c1cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:57408/0 (socket says 172.21.15.135:57408) 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa1458640 1 -- 172.21.15.135:0/900992621 learned_addr learned my addr 172.21.15.135:0/900992621 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:40.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa1c59640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c0a8cb0 0x7eff9c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa0c57640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9c0a9e30 0x7eff9c1ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c0a3820 con 0x7eff9c0a9e30 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c0a2f40 con 0x7eff9c0a8cb0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.520+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c0a4b60 con 0x7eff880053f0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 -- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c0a8cb0 msgr2=0x7eff9c0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff9c0a8cb0 0x7eff9c0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 -- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9c0a9e30 msgr2=0x7eff9c1ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9c0a9e30 0x7eff9c1ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c0aa370 con 0x7eff880053f0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa0c57640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9c0a9e30 0x7eff9c1ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.521+0000 7effa1458640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff9c1cdb80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d500 tx=0x7eff9800d9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.522+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98018070 con 0x7eff880053f0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.522+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff98012b10 con 0x7eff880053f0 2024-05-09T12:29:40.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.522+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c0aa610 con 0x7eff880053f0 2024-05-09T12:29:40.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.522+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9801c400 con 0x7eff880053f0 2024-05-09T12:29:40.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.523+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c071ba0 con 0x7eff880053f0 2024-05-09T12:29:40.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.525+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff9c069a50 con 0x7eff880053f0 2024-05-09T12:29:40.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.527+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff9801c5a0 con 0x7eff880053f0 2024-05-09T12:29:40.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.527+0000 7eff91ffb640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7eff800762d0 0x7eff80078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7effa0c57640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7eff800762d0 0x7eff80078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7eff9809acc0 con 0x7eff880053f0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7eff91ffb640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7eff8007e140 0x7eff800805c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7effa0c57640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7eff800762d0 0x7eff80078790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff9c1336d0 tx=0x7eff8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff80080c90 con 0x7eff8007e140 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7eff9809d320 con 0x7eff880053f0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.528+0000 7effa1c59640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7eff8007e140 0x7eff800805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.529+0000 7effa1c59640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7eff8007e140 0x7eff800805c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.530+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== osd.3 v2:172.21.15.160:6808/2030310005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff80080c90 con 0x7eff8007e140 2024-05-09T12:29:40.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.554+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 --> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff9c070a20 con 0x7eff8007e140 2024-05-09T12:29:40.556 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-09T12:29:40.556 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T12:29:40.556 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-09T12:29:40.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.554+0000 7eff91ffb640 1 -- 172.21.15.135:0/900992621 <== osd.3 v2:172.21.15.160:6808/2030310005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff9c070a20 con 0x7eff8007e140 2024-05-09T12:29:40.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7eff8007e140 msgr2=0x7eff800805c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:6808/2030310005,v1:172.21.15.160:6809/2030310005] conn(0x7eff8007e140 0x7eff800805c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7eff800762d0 msgr2=0x7eff80078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7eff800762d0 0x7eff80078790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff9c1336d0 tx=0x7eff8c008040 comp rx=0 tx=0).stop 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 msgr2=0x7eff9c1cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa36bc640 1 --2- 172.21.15.135:0/900992621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff880053f0 0x7eff9c1cdb80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d500 tx=0x7eff9800d9c0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.555+0000 7effa1c59640 1 -- 172.21.15.135:0/900992621 reap_dead start 2024-05-09T12:29:40.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.557+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 shutdown_connections 2024-05-09T12:29:40.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.557+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 >> 172.21.15.135:0/900992621 conn(0x7eff9c0aaeb0 msgr2=0x7eff9c1357b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:40.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.557+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 shutdown_connections 2024-05-09T12:29:40.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.557+0000 7effa36bc640 1 -- 172.21.15.135:0/900992621 wait complete. 2024-05-09T12:29:40.579 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T12:29:40.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.728+0000 7f5e03683640 1 Processor -- start 2024-05-09T12:29:40.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.728+0000 7f5e03683640 1 -- start start 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e03683640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5dfc1355d0 0x7f5dfc1359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e03683640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dfc072ce0 con 0x7f5dfc135ef0 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e03683640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dfc1353b0 con 0x7f5dfc138e40 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e03683640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f5dfc071b60 con 0x7f5dfc1355d0 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e0141f640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5dfc1355d0 0x7f5dfc1359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e01c20640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5dfc138e40 0x7f5dfc140a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:36566/0 (socket says 172.21.15.135:36566) 2024-05-09T12:29:40.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e01c20640 1 -- 172.21.15.135:0/2302768192 learned_addr learned my addr 172.21.15.135:0/2302768192 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:29:40.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e0141f640 1 -- 172.21.15.135:0/2302768192 >> v1:172.21.15.160:6789/0 conn(0x7f5dfc138e40 legacy=0x7f5dfc140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e0141f640 1 -- 172.21.15.135:0/2302768192 >> v1:172.21.15.135:6789/0 conn(0x7f5dfc135ef0 legacy=0x7f5dfc138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:40.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.729+0000 7f5e0141f640 1 -- 172.21.15.135:0/2302768192 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc09c2c0 con 0x7f5dfc1355d0 2024-05-09T12:29:40.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.731+0000 7f5e0141f640 1 --2- 172.21.15.135:0/2302768192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc1359b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc09cbb0 tx=0x7f5dec02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17489a08e1cf7b23 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.731+0000 7f5df3fff640 1 -- 172.21.15.135:0/2302768192 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec038070 con 0x7f5dfc1355d0 2024-05-09T12:29:40.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.731+0000 7f5df3fff640 1 -- 172.21.15.135:0/2302768192 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec031700 con 0x7f5dfc1355d0 2024-05-09T12:29:40.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.731+0000 7f5df3fff640 1 -- 172.21.15.135:0/2302768192 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec031b10 con 0x7f5dfc1355d0 2024-05-09T12:29:40.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.732+0000 7f5e03683640 1 -- 172.21.15.135:0/2302768192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc1355d0 msgr2=0x7f5dfc1359b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.732+0000 7f5e03683640 1 --2- 172.21.15.135:0/2302768192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc1359b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc09cbb0 tx=0x7f5dec02b7a0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.732+0000 7f5e03683640 1 -- 172.21.15.135:0/2302768192 shutdown_connections 2024-05-09T12:29:40.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.732+0000 7f5e03683640 1 --2- 172.21.15.135:0/2302768192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc1359b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.732+0000 7f5e03683640 1 -- 172.21.15.135:0/2302768192 >> 172.21.15.135:0/2302768192 conn(0x7f5dfc0aa930 msgr2=0x7f5dfc0aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:40.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.733+0000 7f5e03683640 1 -- 172.21.15.135:0/2302768192 shutdown_connections 2024-05-09T12:29:40.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.733+0000 7f5e03683640 1 -- 172.21.15.135:0/2302768192 wait complete. 2024-05-09T12:29:40.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.734+0000 7f5e03683640 1 Processor -- start 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.734+0000 7f5e03683640 1 -- start start 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc135ef0 0x7f5dfc0a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5dfc138e40 0x7f5dfc0a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc071550 con 0x7f5dfc1355d0 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc070cd0 con 0x7f5dfc135ef0 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e03683640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0716d0 con 0x7f5dfc138e40 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e0141f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e0141f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37374/0 (socket says 172.21.15.135:37374) 2024-05-09T12:29:40.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.735+0000 7f5e0141f640 1 -- 172.21.15.135:0/975288221 learned_addr learned my addr 172.21.15.135:0/975288221 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e01c20640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5dfc138e40 0x7f5dfc0a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e00c1e640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc135ef0 0x7f5dfc0a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e0141f640 1 -- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5dfc138e40 msgr2=0x7f5dfc0a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e0141f640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5dfc138e40 0x7f5dfc0a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e0141f640 1 -- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc135ef0 msgr2=0x7f5dfc0a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e0141f640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc135ef0 0x7f5dfc0a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.736+0000 7f5e0141f640 1 -- 172.21.15.135:0/975288221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc146470 con 0x7f5dfc1355d0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.737+0000 7f5e0141f640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f5dec02bdb0 tx=0x7f5dec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.737+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec043070 con 0x7f5dfc1355d0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.737+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec033a00 con 0x7f5dfc1355d0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.737+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec038040 con 0x7f5dfc1355d0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.737+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc071270 con 0x7f5dfc1355d0 2024-05-09T12:29:40.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.738+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc0a7ef0 con 0x7f5dfc1355d0 2024-05-09T12:29:40.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.739+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc0508d0 con 0x7f5dfc1355d0 2024-05-09T12:29:40.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.741+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5dec046070 con 0x7f5dfc1355d0 2024-05-09T12:29:40.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.742+0000 7f5df1ffb640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 0x7f5de0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:40.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.742+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7f5dec0b8ce0 con 0x7f5dfc1355d0 2024-05-09T12:29:40.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.742+0000 7f5e00c1e640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 0x7f5de0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:40.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.743+0000 7f5e00c1e640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 0x7f5de0078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0a79d0 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:40.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:40.749+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5dec030070 con 0x7f5dfc1355d0 2024-05-09T12:29:41.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.071+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5dfc138240 con 0x7f5de00763a0 2024-05-09T12:29:41.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.072+0000 7f5df1ffb640 1 -- 172.21.15.135:0/975288221 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5dfc138240 con 0x7f5de00763a0 2024-05-09T12:29:41.073 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 msgr2=0x7f5de0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 0x7f5de0078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0a79d0 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 msgr2=0x7f5dfc147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f5dec02bdb0 tx=0x7f5dec0046c0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 shutdown_connections 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5de00763a0 0x7f5de0078860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5dfc138e40 0x7f5dfc0a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5dfc135ef0 0x7f5dfc0a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 --2- 172.21.15.135:0/975288221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dfc1355d0 0x7f5dfc147420 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 >> 172.21.15.135:0/975288221 conn(0x7f5dfc0aa930 msgr2=0x7f5dfc06f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:41.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 shutdown_connections 2024-05-09T12:29:41.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.076+0000 7f5e03683640 1 -- 172.21.15.135:0/975288221 wait complete. 2024-05-09T12:29:41.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:29:41.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.246+0000 7fd5d809b640 1 Processor -- start 2024-05-09T12:29:41.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.246+0000 7fd5d809b640 1 -- start start 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d809b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d809b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 0x7fd5d013cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d809b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d009dcf0 con 0x7fd5d013d060 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d809b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d009dad0 con 0x7fd5d01397a0 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d809b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d009d790 con 0x7fd5d013c6e0 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d5e37640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d5e37640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37382/0 (socket says 172.21.15.135:37382) 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d6638640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd5d013d060 0x7fd5d0143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:42540/0 (socket says 172.21.15.135:42540) 2024-05-09T12:29:41.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.247+0000 7fd5d5e37640 1 -- 172.21.15.135:0/885148699 learned_addr learned my addr 172.21.15.135:0/885148699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.248+0000 7fd5d5636640 1 --2- 172.21.15.135:0/885148699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 0x7fd5d013cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.248+0000 7fd5d4e35640 1 -- 172.21.15.135:0/885148699 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234447289 0 0) 0x7fd5d009dcf0 con 0x7fd5d013d060 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.249+0000 7fd5d5636640 1 -- 172.21.15.135:0/885148699 >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 msgr2=0x7fd5d0139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.249+0000 7fd5d5636640 1 --2- 172.21.15.135:0/885148699 >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.249+0000 7fd5d5636640 1 -- 172.21.15.135:0/885148699 >> v1:172.21.15.135:6789/0 conn(0x7fd5d013d060 legacy=0x7fd5d0143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.249+0000 7fd5d5636640 1 -- 172.21.15.135:0/885148699 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d013a0c0 con 0x7fd5d013c6e0 2024-05-09T12:29:41.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.249+0000 7fd5d5e37640 1 --2- 172.21.15.135:0/885148699 >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:29:41.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.250+0000 7fd5d5636640 1 --2- 172.21.15.135:0/885148699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 0x7fd5d013cb20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00097a0 tx=0x7fd5c002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c508a9bce35fe095 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:41.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.250+0000 7fd5d4e35640 1 -- 172.21.15.135:0/885148699 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0031780 con 0x7fd5d013c6e0 2024-05-09T12:29:41.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.250+0000 7fd5d4e35640 1 -- 172.21.15.135:0/885148699 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c0037070 con 0x7fd5d013c6e0 2024-05-09T12:29:41.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.250+0000 7fd5d4e35640 1 -- 172.21.15.135:0/885148699 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0031b40 con 0x7fd5d013c6e0 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.251+0000 7fd5d809b640 1 -- 172.21.15.135:0/885148699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 msgr2=0x7fd5d013cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.251+0000 7fd5d809b640 1 --2- 172.21.15.135:0/885148699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 0x7fd5d013cb20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00097a0 tx=0x7fd5c002b820 comp rx=0 tx=0).stop 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 -- 172.21.15.135:0/885148699 shutdown_connections 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 --2- 172.21.15.135:0/885148699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d013c6e0 0x7fd5d013cb20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 --2- 172.21.15.135:0/885148699 >> v2:172.21.15.135:3300/0 conn(0x7fd5d01397a0 0x7fd5d0139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 -- 172.21.15.135:0/885148699 >> 172.21.15.135:0/885148699 conn(0x7fd5d0075da0 msgr2=0x7fd5d00aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 -- 172.21.15.135:0/885148699 shutdown_connections 2024-05-09T12:29:41.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.252+0000 7fd5d809b640 1 -- 172.21.15.135:0/885148699 wait complete. 2024-05-09T12:29:41.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.253+0000 7fd5d809b640 1 Processor -- start 2024-05-09T12:29:41.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.253+0000 7fd5d809b640 1 -- start start 2024-05-09T12:29:41.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d01397a0 0x7fd5d00a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 0x7fd5d00a2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d009cd40 con 0x7fd5d013d060 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d013d4d0 con 0x7fd5d013c6e0 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d809b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d009c220 con 0x7fd5d01397a0 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d5636640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 0x7fd5d00a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d5636640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 0x7fd5d00a2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:41586/0 (socket says 172.21.15.135:41586) 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d5636640 1 -- 172.21.15.135:0/783353843 learned_addr learned my addr 172.21.15.135:0/783353843 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37388/0 (socket says 172.21.15.135:37388) 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d5e37640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d01397a0 0x7fd5d00a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 -- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d01397a0 msgr2=0x7fd5d00a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d01397a0 0x7fd5d00a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 -- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 msgr2=0x7fd5d00a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.254+0000 7fd5d6638640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 0x7fd5d00a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5d6638640 1 -- 172.21.15.135:0/783353843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d00a4bd0 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5d6638640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c7b0 tx=0x7fd5c800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8018070 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8004d70 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800a860 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.255+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d00a3390 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.256+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d00a53a0 con 0x7fd5d013d060 2024-05-09T12:29:41.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.257+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00a55e0 con 0x7fd5d013d060 2024-05-09T12:29:41.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.259+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5c801b070 con 0x7fd5d013d060 2024-05-09T12:29:41.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.259+0000 7fd5c67fc640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 0x7fd5b4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:29:41.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.259+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4478+0+0 (secure 0 0 0) 0x7fd5c8096aa0 con 0x7fd5d013d060 2024-05-09T12:29:41.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.261+0000 7fd5d5e37640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 0x7fd5b4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:29:41.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.262+0000 7fd5d5e37640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 0x7fd5b4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc011fb0 tx=0x7fd5cc013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:29:41.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.267+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd5c8022020 con 0x7fd5d013d060 2024-05-09T12:29:41.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.559+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5d00508d0 con 0x7fd5b40763a0 2024-05-09T12:29:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.566+0000 7fd5c67fc640 1 -- 172.21.15.135:0/783353843 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+274114 (secure 0 0 0) 0x7fd5d00508d0 con 0x7fd5b40763a0 2024-05-09T12:29:41.571 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:29:41.574 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:29:41.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 msgr2=0x7fd5b4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 0x7fd5b4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc011fb0 tx=0x7fd5cc013040 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 msgr2=0x7fd5d00a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c7b0 tx=0x7fd5c800cbb0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 shutdown_connections 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fd5b40763a0 0x7fd5b4078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5d013d060 0x7fd5d00a2d50 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5d013c6e0 0x7fd5d00a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 --2- 172.21.15.135:0/783353843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5d01397a0 0x7fd5d00a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 >> 172.21.15.135:0/783353843 conn(0x7fd5d0075da0 msgr2=0x7fd5d013a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 shutdown_connections 2024-05-09T12:29:41.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:29:41.572+0000 7fd5d809b640 1 -- 172.21.15.135:0/783353843 wait complete. 2024-05-09T12:29:41.591 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-05-09T12:29:41.486441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":287936469,"num_objects":13916,"num_object_clones":6845,"num_object_copies":27832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13916,"num_whiteouts":6837,"num_read":255,"num_read_kb":3256,"num_write":164635,"num_write_kb":617697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277511,"ondisk_log_size":277511,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3108232,"kb_used_data":620768,"kb_used_omap":6,"kb_used_meta":2487417,"kb_avail":374379128,"statfs":{"total":386547056640,"available":383364227072,"internally_reserved":0,"allocated":635666432,"data_stored":576425028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2547115798},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4793298,"num_objects":-29823,"num_object_clones":-21542,"num_object_copies":-59646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-29823,"num_whiteouts":-6439,"num_read":3,"num_read_kb":184,"num_write":1880,"num_write_kb":4958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002388"},"pg_stats":[{"pgid":"4.3f","version":"34'2670","reported_seq":2172,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.491155+0000","last_change":"2024-05-09T12:29:35.491155+0000","last_active":"2024-05-09T12:29:35.491155+0000","last_peered":"2024-05-09T12:29:35.491155+0000","last_clean":"2024-05-09T12:29:35.491155+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:29:35.491155+0000","last_undegraded":"2024-05-09T12:29:35.491155+0000","last_fullsized":"2024-05-09T12:29:35.491155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2670,"log_dups_size":0,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":242,"snaptrim_duration":8.4874418570000003,"stat_sum":{"num_bytes":2280,"num_objects":380,"num_object_clones":190,"num_object_copies":760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":380,"num_whiteouts":190,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3e","version":"34'3197","reported_seq":2587,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.070798+0000","last_change":"2024-05-09T12:29:36.070821+0000","last_active":"2024-05-09T12:29:36.070798+0000","last_peered":"2024-05-09T12:29:36.070798+0000","last_clean":"2024-05-09T12:29:36.070798+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:29:36.070798+0000","last_undegraded":"2024-05-09T12:29:36.070798+0000","last_fullsized":"2024-05-09T12:29:36.070798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:35:26.401558+0000","scrub_duration":0,"objects_trimmed":448,"snaptrim_duration":9.0710093759999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.3d","version":"34'2885","reported_seq":2388,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.014646+0000","last_change":"2024-05-09T12:29:35.014675+0000","last_active":"2024-05-09T12:29:35.014646+0000","last_peered":"2024-05-09T12:29:35.014646+0000","last_clean":"2024-05-09T12:29:35.014646+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:35.014646+0000","last_undegraded":"2024-05-09T12:29:35.014646+0000","last_fullsized":"2024-05-09T12:29:35.014646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2885,"log_dups_size":0,"ondisk_log_size":2885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:37.681515+0000","scrub_duration":0,"objects_trimmed":265,"snaptrim_duration":8.0154481069999992,"stat_sum":{"num_bytes":2388,"num_objects":400,"num_object_clones":200,"num_object_copies":800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3c","version":"34'3472","reported_seq":2768,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.137851+0000","last_change":"2024-05-09T12:29:37.137878+0000","last_active":"2024-05-09T12:29:37.137851+0000","last_peered":"2024-05-09T12:29:37.137851+0000","last_clean":"2024-05-09T12:29:37.137851+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:29:37.137851+0000","last_undegraded":"2024-05-09T12:29:37.137851+0000","last_fullsized":"2024-05-09T12:29:37.137851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":735,"snaptrim_duration":10.138920654,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.3b","version":"34'2975","reported_seq":2441,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.351883+0000","last_change":"2024-05-09T12:29:36.351883+0000","last_active":"2024-05-09T12:29:36.351883+0000","last_peered":"2024-05-09T12:29:36.351883+0000","last_clean":"2024-05-09T12:29:36.351883+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:36.351883+0000","last_undegraded":"2024-05-09T12:29:36.351883+0000","last_fullsized":"2024-05-09T12:29:36.351883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":0,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":282,"snaptrim_duration":9.3426929120000004,"stat_sum":{"num_bytes":2479,"num_objects":410,"num_object_clones":205,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":204,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.3a","version":"34'3333","reported_seq":2713,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.512924+0000","last_change":"2024-05-09T12:29:38.657712+0000","last_active":"2024-05-09T12:29:39.512924+0000","last_peered":"2024-05-09T12:29:39.512924+0000","last_clean":"2024-05-09T12:29:39.512924+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:39.512924+0000","last_undegraded":"2024-05-09T12:29:39.512924+0000","last_fullsized":"2024-05-09T12:29:39.512924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:42.539745+0000","scrub_duration":0,"objects_trimmed":684,"snaptrim_duration":3.3343178679999999,"stat_sum":{"num_bytes":38,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.39","version":"34'3248","reported_seq":2643,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.931369+0000","last_change":"2024-05-09T12:29:36.931404+0000","last_active":"2024-05-09T12:29:36.931369+0000","last_peered":"2024-05-09T12:29:36.931369+0000","last_clean":"2024-05-09T12:29:36.931369+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:29:36.931369+0000","last_undegraded":"2024-05-09T12:29:36.931369+0000","last_fullsized":"2024-05-09T12:29:36.931369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:23.626842+0000","scrub_duration":0,"objects_trimmed":448,"snaptrim_duration":9.9308651349999995,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.38","version":"34'3145","reported_seq":2538,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.733153+0000","last_change":"2024-05-09T12:29:37.733193+0000","last_active":"2024-05-09T12:29:37.733153+0000","last_peered":"2024-05-09T12:29:37.733153+0000","last_clean":"2024-05-09T12:29:37.733153+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:37.733153+0000","last_undegraded":"2024-05-09T12:29:37.733153+0000","last_fullsized":"2024-05-09T12:29:37.733153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3145,"log_dups_size":0,"ondisk_log_size":3145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:25.065692+0000","scrub_duration":0,"objects_trimmed":466,"snaptrim_duration":10.732543230999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.37","version":"34'2951","reported_seq":2416,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.704258+0000","last_change":"2024-05-09T12:29:32.704258+0000","last_active":"2024-05-09T12:29:32.704258+0000","last_peered":"2024-05-09T12:29:32.704258+0000","last_clean":"2024-05-09T12:29:32.704258+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:32.704258+0000","last_undegraded":"2024-05-09T12:29:32.704258+0000","last_fullsized":"2024-05-09T12:29:32.704258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2951,"log_dups_size":0,"ondisk_log_size":2951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":5.7016304350000002,"stat_sum":{"num_bytes":6579,"num_objects":416,"num_object_clones":206,"num_object_copies":832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.36","version":"34'2524","reported_seq":2067,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.385621+0000","last_change":"2024-05-09T12:29:32.385651+0000","last_active":"2024-05-09T12:29:32.385621+0000","last_peered":"2024-05-09T12:29:32.385621+0000","last_clean":"2024-05-09T12:29:32.385621+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:29:32.385621+0000","last_undegraded":"2024-05-09T12:29:32.385621+0000","last_fullsized":"2024-05-09T12:29:32.385621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2524,"log_dups_size":0,"ondisk_log_size":2524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:40.886862+0000","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":5.3845229720000001,"stat_sum":{"num_bytes":6340,"num_objects":376,"num_object_clones":187,"num_object_copies":752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":376,"num_whiteouts":187,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.35","version":"34'2977","reported_seq":2410,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.102383+0000","last_change":"2024-05-09T12:29:35.102424+0000","last_active":"2024-05-09T12:29:35.102383+0000","last_peered":"2024-05-09T12:29:35.102383+0000","last_clean":"2024-05-09T12:29:35.102383+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:35.102383+0000","last_undegraded":"2024-05-09T12:29:35.102383+0000","last_fullsized":"2024-05-09T12:29:35.102383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:19:09.204008+0000","scrub_duration":0,"objects_trimmed":419,"snaptrim_duration":8.1021071990000006,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.34","version":"34'3179","reported_seq":2538,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.080128+0000","last_change":"2024-05-09T12:29:38.080166+0000","last_active":"2024-05-09T12:29:38.080128+0000","last_peered":"2024-05-09T12:29:38.080128+0000","last_clean":"2024-05-09T12:29:38.080128+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:38.080128+0000","last_undegraded":"2024-05-09T12:29:38.080128+0000","last_fullsized":"2024-05-09T12:29:38.080128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3179,"log_dups_size":0,"ondisk_log_size":3179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:31.554547+0000","scrub_duration":0,"objects_trimmed":714,"snaptrim_duration":11.06769053,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.33","version":"34'3241","reported_seq":2654,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.349663+0000","last_change":"2024-05-09T12:29:39.349682+0000","last_active":"2024-05-09T12:29:39.349663+0000","last_peered":"2024-05-09T12:29:39.349663+0000","last_clean":"2024-05-09T12:29:39.349663+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:29:39.349663+0000","last_undegraded":"2024-05-09T12:29:39.349663+0000","last_fullsized":"2024-05-09T12:29:39.349663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":621,"snaptrim_duration":12.343080629999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.32","version":"34'3506","reported_seq":2850,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.135807+0000","last_change":"2024-05-09T12:29:39.135839+0000","last_active":"2024-05-09T12:29:39.135807+0000","last_peered":"2024-05-09T12:29:39.135807+0000","last_clean":"2024-05-09T12:29:39.135807+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:39.135807+0000","last_undegraded":"2024-05-09T12:29:39.135807+0000","last_fullsized":"2024-05-09T12:29:39.135807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3506,"log_dups_size":0,"ondisk_log_size":3506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":719,"snaptrim_duration":12.13694179,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.31","version":"34'3393","reported_seq":2753,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.241307+0000","last_change":"2024-05-09T12:29:37.241347+0000","last_active":"2024-05-09T12:29:37.241307+0000","last_peered":"2024-05-09T12:29:37.241307+0000","last_clean":"2024-05-09T12:29:37.241307+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:29:37.241307+0000","last_undegraded":"2024-05-09T12:29:37.241307+0000","last_fullsized":"2024-05-09T12:29:37.241307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:53.594808+0000","scrub_duration":0,"objects_trimmed":701,"snaptrim_duration":10.240469529,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.30","version":"34'3269","reported_seq":2636,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.077218+0000","last_change":"2024-05-09T12:29:38.077263+0000","last_active":"2024-05-09T12:29:38.077218+0000","last_peered":"2024-05-09T12:29:38.077218+0000","last_clean":"2024-05-09T12:29:38.077218+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:38.077218+0000","last_undegraded":"2024-05-09T12:29:38.077218+0000","last_fullsized":"2024-05-09T12:29:38.077218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:49:35.092328+0000","scrub_duration":0,"objects_trimmed":659,"snaptrim_duration":11.076418836,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.2f","version":"34'3100","reported_seq":2506,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.156806+0000","last_change":"2024-05-09T12:29:33.156806+0000","last_active":"2024-05-09T12:29:33.156806+0000","last_peered":"2024-05-09T12:29:33.156806+0000","last_clean":"2024-05-09T12:29:33.156806+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:33.156806+0000","last_undegraded":"2024-05-09T12:29:33.156806+0000","last_fullsized":"2024-05-09T12:29:33.156806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3100,"log_dups_size":0,"ondisk_log_size":3100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":298,"snaptrim_duration":6.1535401160000003,"stat_sum":{"num_bytes":2784,"num_objects":465,"num_object_clones":232,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":465,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2e","version":"34'2360","reported_seq":1932,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.642736+0000","last_change":"2024-05-09T12:29:33.642775+0000","last_active":"2024-05-09T12:29:33.642736+0000","last_peered":"2024-05-09T12:29:33.642736+0000","last_clean":"2024-05-09T12:29:33.642736+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:33.642736+0000","last_undegraded":"2024-05-09T12:29:33.642736+0000","last_fullsized":"2024-05-09T12:29:33.642736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2360,"log_dups_size":0,"ondisk_log_size":2360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:13:30.515742+0000","scrub_duration":0,"objects_trimmed":226,"snaptrim_duration":6.641452707,"stat_sum":{"num_bytes":2109,"num_objects":351,"num_object_clones":175,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":174,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2d","version":"34'2985","reported_seq":2454,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.565637+0000","last_change":"2024-05-09T12:29:39.349653+0000","last_active":"2024-05-09T12:29:39.565637+0000","last_peered":"2024-05-09T12:29:39.565637+0000","last_clean":"2024-05-09T12:29:39.565637+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:39.565637+0000","last_undegraded":"2024-05-09T12:29:39.565637+0000","last_fullsized":"2024-05-09T12:29:39.565637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2985,"log_dups_size":0,"ondisk_log_size":2985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"user requested deep scrub scheduled @ 2024-05-09T12:29:44.515640+0000","scrub_duration":0,"objects_trimmed":356,"snaptrim_duration":3.3445633849999998,"stat_sum":{"num_bytes":5896,"num_objects":303,"num_object_clones":150,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":150,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2c","version":"34'3273","reported_seq":2647,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.511874+0000","last_change":"2024-05-09T12:29:38.781991+0000","last_active":"2024-05-09T12:29:39.511874+0000","last_peered":"2024-05-09T12:29:39.511874+0000","last_clean":"2024-05-09T12:29:39.511874+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:39.511874+0000","last_undegraded":"2024-05-09T12:29:39.511874+0000","last_fullsized":"2024-05-09T12:29:39.511874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3273,"log_dups_size":0,"ondisk_log_size":3273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:28:18.831229+0000","scrub_duration":0,"objects_trimmed":616,"snaptrim_duration":4.2925059000000001,"stat_sum":{"num_bytes":8600,"num_objects":70,"num_object_clones":34,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":34,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2b","version":"34'3060","reported_seq":2524,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.507261+0000","last_change":"2024-05-09T12:29:39.021683+0000","last_active":"2024-05-09T12:29:39.507261+0000","last_peered":"2024-05-09T12:29:39.507261+0000","last_clean":"2024-05-09T12:29:39.507261+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:29:39.507261+0000","last_undegraded":"2024-05-09T12:29:39.507261+0000","last_fullsized":"2024-05-09T12:29:39.507261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3060,"log_dups_size":0,"ondisk_log_size":3060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":471,"snaptrim_duration":5.8356664780000003,"stat_sum":{"num_bytes":1044,"num_objects":177,"num_object_clones":88,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":88,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.2a","version":"34'3470","reported_seq":2774,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.600371+0000","last_change":"2024-05-09T12:29:38.600371+0000","last_active":"2024-05-09T12:29:38.600371+0000","last_peered":"2024-05-09T12:29:38.600371+0000","last_clean":"2024-05-09T12:29:38.600371+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:38.600371+0000","last_undegraded":"2024-05-09T12:29:38.600371+0000","last_fullsized":"2024-05-09T12:29:38.600371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":483,"snaptrim_duration":11.597337599999999,"stat_sum":{"num_bytes":4116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.29","version":"34'3162","reported_seq":2582,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.145458+0000","last_change":"2024-05-09T12:29:36.145500+0000","last_active":"2024-05-09T12:29:36.145458+0000","last_peered":"2024-05-09T12:29:36.145458+0000","last_clean":"2024-05-09T12:29:36.145458+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:29:36.145458+0000","last_undegraded":"2024-05-09T12:29:36.145458+0000","last_fullsized":"2024-05-09T12:29:36.145458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3162,"log_dups_size":0,"ondisk_log_size":3162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:33:55.785696+0000","scrub_duration":0,"objects_trimmed":392,"snaptrim_duration":9.1339050339999996,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.28","version":"34'3412","reported_seq":2741,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.781918+0000","last_change":"2024-05-09T12:29:38.781961+0000","last_active":"2024-05-09T12:29:38.781918+0000","last_peered":"2024-05-09T12:29:38.781918+0000","last_clean":"2024-05-09T12:29:38.781918+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:38.781918+0000","last_undegraded":"2024-05-09T12:29:38.781918+0000","last_fullsized":"2024-05-09T12:29:38.781918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3412,"log_dups_size":0,"ondisk_log_size":3412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:42.345451+0000","scrub_duration":0,"objects_trimmed":680,"snaptrim_duration":11.780943062,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.27","version":"34'2942","reported_seq":2383,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.916674+0000","last_change":"2024-05-09T12:29:36.916817+0000","last_active":"2024-05-09T12:29:36.916674+0000","last_peered":"2024-05-09T12:29:36.916674+0000","last_clean":"2024-05-09T12:29:36.916674+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:36.916674+0000","last_undegraded":"2024-05-09T12:29:36.916674+0000","last_fullsized":"2024-05-09T12:29:36.916674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2942,"log_dups_size":0,"ondisk_log_size":2942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:44.831448+0000","scrub_duration":0,"objects_trimmed":573,"snaptrim_duration":9.8944325529999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.26","version":"34'3480","reported_seq":2819,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.563058+0000","last_change":"2024-05-09T12:29:38.563101+0000","last_active":"2024-05-09T12:29:38.563058+0000","last_peered":"2024-05-09T12:29:38.563058+0000","last_clean":"2024-05-09T12:29:38.563058+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:38.563058+0000","last_undegraded":"2024-05-09T12:29:38.563058+0000","last_fullsized":"2024-05-09T12:29:38.563058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:43:39.979039+0000","scrub_duration":0,"objects_trimmed":660,"snaptrim_duration":11.548768498999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.25","version":"34'2741","reported_seq":2219,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.310097+0000","last_change":"2024-05-09T12:29:35.310135+0000","last_active":"2024-05-09T12:29:35.310097+0000","last_peered":"2024-05-09T12:29:35.310097+0000","last_clean":"2024-05-09T12:29:35.310097+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:29:35.310097+0000","last_undegraded":"2024-05-09T12:29:35.310097+0000","last_fullsized":"2024-05-09T12:29:35.310097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:11.263037+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":8.3107807040000008,"stat_sum":{"num_bytes":2376,"num_objects":396,"num_object_clones":198,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":198,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.24","version":"34'2976","reported_seq":2403,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.653467+0000","last_change":"2024-05-09T12:29:37.653503+0000","last_active":"2024-05-09T12:29:37.653467+0000","last_peered":"2024-05-09T12:29:37.653467+0000","last_clean":"2024-05-09T12:29:37.653467+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:29:37.653467+0000","last_undegraded":"2024-05-09T12:29:37.653467+0000","last_fullsized":"2024-05-09T12:29:37.653467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:23.747102+0000","scrub_duration":0,"objects_trimmed":644,"snaptrim_duration":10.637853825000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.23","version":"34'3123","reported_seq":2524,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.560157+0000","last_change":"2024-05-09T12:29:39.195583+0000","last_active":"2024-05-09T12:29:39.560157+0000","last_peered":"2024-05-09T12:29:39.560157+0000","last_clean":"2024-05-09T12:29:39.560157+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:29:39.560157+0000","last_undegraded":"2024-05-09T12:29:39.560157+0000","last_fullsized":"2024-05-09T12:29:39.560157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3123,"log_dups_size":0,"ondisk_log_size":3123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"user requested deep scrub scheduled @ 2024-05-09T12:29:44.510399+0000","scrub_duration":0,"objects_trimmed":440,"snaptrim_duration":3.137882941,"stat_sum":{"num_bytes":1673,"num_objects":277,"num_object_clones":138,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":137,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.22","version":"34'2675","reported_seq":2198,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.705627+0000","last_change":"2024-05-09T12:29:31.705667+0000","last_active":"2024-05-09T12:29:31.705627+0000","last_peered":"2024-05-09T12:29:31.705627+0000","last_clean":"2024-05-09T12:29:31.705627+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:31.705627+0000","last_undegraded":"2024-05-09T12:29:31.705627+0000","last_fullsized":"2024-05-09T12:29:31.705627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2675,"log_dups_size":0,"ondisk_log_size":2675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:01.045896+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":4.7063701230000001,"stat_sum":{"num_bytes":2217,"num_objects":370,"num_object_clones":184,"num_object_copies":740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":370,"num_whiteouts":184,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"4.21","version":"34'3623","reported_seq":2890,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.273853+0000","last_change":"2024-05-09T12:29:37.273894+0000","last_active":"2024-05-09T12:29:37.273853+0000","last_peered":"2024-05-09T12:29:37.273853+0000","last_clean":"2024-05-09T12:29:37.273853+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:37.273853+0000","last_undegraded":"2024-05-09T12:29:37.273853+0000","last_fullsized":"2024-05-09T12:29:37.273853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3623,"log_dups_size":0,"ondisk_log_size":3623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:16.312292+0000","scrub_duration":0,"objects_trimmed":738,"snaptrim_duration":10.26210953,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.20","version":"34'3689","reported_seq":3006,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.021570+0000","last_change":"2024-05-09T12:29:39.021607+0000","last_active":"2024-05-09T12:29:39.021570+0000","last_peered":"2024-05-09T12:29:39.021570+0000","last_clean":"2024-05-09T12:29:39.021570+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:39.021570+0000","last_undegraded":"2024-05-09T12:29:39.021570+0000","last_fullsized":"2024-05-09T12:29:39.021570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3689,"log_dups_size":0,"ondisk_log_size":3689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:14:49.401316+0000","scrub_duration":0,"objects_trimmed":732,"snaptrim_duration":12.021193760999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.14","version":"34'2903","reported_seq":2351,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.361442+0000","last_change":"2024-05-09T12:29:34.361479+0000","last_active":"2024-05-09T12:29:34.361442+0000","last_peered":"2024-05-09T12:29:34.361442+0000","last_clean":"2024-05-09T12:29:34.361442+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:29:34.361442+0000","last_undegraded":"2024-05-09T12:29:34.361442+0000","last_fullsized":"2024-05-09T12:29:34.361442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:55.441325+0000","scrub_duration":0,"objects_trimmed":277,"snaptrim_duration":7.3455076220000004,"stat_sum":{"num_bytes":10844,"num_objects":444,"num_object_clones":221,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":221,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.13","version":"32'4093","reported_seq":4144,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000651+0000","last_change":"2024-05-09T12:20:20.628926+0000","last_active":"2024-05-09T12:29:27.000651+0000","last_peered":"2024-05-09T12:29:27.000651+0000","last_clean":"2024-05-09T12:29:27.000651+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:27.000651+0000","last_undegraded":"2024-05-09T12:29:27.000651+0000","last_fullsized":"2024-05-09T12:29:27.000651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4093,"log_dups_size":0,"ondisk_log_size":4093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:58.560025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'2852","reported_seq":2322,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.158666+0000","last_change":"2024-05-09T12:29:37.158707+0000","last_active":"2024-05-09T12:29:37.158666+0000","last_peered":"2024-05-09T12:29:37.158666+0000","last_clean":"2024-05-09T12:29:37.158666+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:29:37.158666+0000","last_undegraded":"2024-05-09T12:29:37.158666+0000","last_fullsized":"2024-05-09T12:29:37.158666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:24.899101+0000","scrub_duration":0,"objects_trimmed":266,"snaptrim_duration":10.158944295,"stat_sum":{"num_bytes":2472,"num_objects":414,"num_object_clones":206,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.12","version":"32'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003915+0000","last_change":"2024-05-09T12:20:20.631682+0000","last_active":"2024-05-09T12:29:27.003915+0000","last_peered":"2024-05-09T12:29:27.003915+0000","last_clean":"2024-05-09T12:29:27.003915+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:27.003915+0000","last_undegraded":"2024-05-09T12:29:27.003915+0000","last_fullsized":"2024-05-09T12:29:27.003915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'3067","reported_seq":2551,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.483937+0000","last_change":"2024-05-09T12:29:37.483937+0000","last_active":"2024-05-09T12:29:37.483937+0000","last_peered":"2024-05-09T12:29:37.483937+0000","last_clean":"2024-05-09T12:29:37.483937+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:37.483937+0000","last_undegraded":"2024-05-09T12:29:37.483937+0000","last_fullsized":"2024-05-09T12:29:37.483937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3067,"log_dups_size":0,"ondisk_log_size":3067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":263,"snaptrim_duration":10.480177385999999,"stat_sum":{"num_bytes":2388,"num_objects":400,"num_object_clones":199,"num_object_copies":800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":199,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.11","version":"32'623","reported_seq":674,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000613+0000","last_change":"2024-05-09T12:20:20.634094+0000","last_active":"2024-05-09T12:29:27.000613+0000","last_peered":"2024-05-09T12:29:27.000613+0000","last_clean":"2024-05-09T12:29:27.000613+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:27.000613+0000","last_undegraded":"2024-05-09T12:29:27.000613+0000","last_fullsized":"2024-05-09T12:29:27.000613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:44.658725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"34'2856","reported_seq":2322,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.441116+0000","last_change":"2024-05-09T12:29:34.441116+0000","last_active":"2024-05-09T12:29:34.441116+0000","last_peered":"2024-05-09T12:29:34.441116+0000","last_clean":"2024-05-09T12:29:34.441116+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:34.441116+0000","last_undegraded":"2024-05-09T12:29:34.441116+0000","last_fullsized":"2024-05-09T12:29:34.441116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":7.4376879169999999,"stat_sum":{"num_bytes":6640,"num_objects":425,"num_object_clones":212,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.10","version":"32'57","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001159+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:29:27.001159+0000","last_peered":"2024-05-09T12:29:27.001159+0000","last_clean":"2024-05-09T12:29:27.001159+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:29:27.001159+0000","last_undegraded":"2024-05-09T12:29:27.001159+0000","last_fullsized":"2024-05-09T12:29:27.001159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:12.066636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'1484","reported_seq":1536,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999804+0000","last_change":"2024-05-09T12:20:20.632148+0000","last_active":"2024-05-09T12:29:26.999804+0000","last_peered":"2024-05-09T12:29:26.999804+0000","last_clean":"2024-05-09T12:29:26.999804+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:26.999804+0000","last_undegraded":"2024-05-09T12:29:26.999804+0000","last_fullsized":"2024-05-09T12:29:26.999804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"34'3241","reported_seq":2610,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.657647+0000","last_change":"2024-05-09T12:29:38.657687+0000","last_active":"2024-05-09T12:29:38.657647+0000","last_peered":"2024-05-09T12:29:38.657647+0000","last_clean":"2024-05-09T12:29:38.657647+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:38.657647+0000","last_undegraded":"2024-05-09T12:29:38.657647+0000","last_fullsized":"2024-05-09T12:29:38.657647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:56.169314+0000","scrub_duration":0,"objects_trimmed":679,"snaptrim_duration":11.656529273,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.e","version":"32'2803","reported_seq":2855,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000131+0000","last_change":"2024-05-09T12:20:20.629641+0000","last_active":"2024-05-09T12:29:27.000131+0000","last_peered":"2024-05-09T12:29:27.000131+0000","last_clean":"2024-05-09T12:29:27.000131+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:27.000131+0000","last_undegraded":"2024-05-09T12:29:27.000131+0000","last_fullsized":"2024-05-09T12:29:27.000131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'3357","reported_seq":2717,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.996610+0000","last_change":"2024-05-09T12:29:37.996645+0000","last_active":"2024-05-09T12:29:37.996610+0000","last_peered":"2024-05-09T12:29:37.996610+0000","last_clean":"2024-05-09T12:29:37.996610+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:29:37.996610+0000","last_undegraded":"2024-05-09T12:29:37.996610+0000","last_fullsized":"2024-05-09T12:29:37.996610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:05:54.659791+0000","scrub_duration":0,"objects_trimmed":669,"snaptrim_duration":10.995448888,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.d","version":"32'6794","reported_seq":6846,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000422+0000","last_change":"2024-05-09T12:20:20.637012+0000","last_active":"2024-05-09T12:29:27.000422+0000","last_peered":"2024-05-09T12:29:27.000422+0000","last_clean":"2024-05-09T12:29:27.000422+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:27.000422+0000","last_undegraded":"2024-05-09T12:29:27.000422+0000","last_fullsized":"2024-05-09T12:29:27.000422+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5594,"log_dups_size":0,"ondisk_log_size":5594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:27:59.973184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"34'2835","reported_seq":2298,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.611158+0000","last_change":"2024-05-09T12:29:33.611181+0000","last_active":"2024-05-09T12:29:33.611158+0000","last_peered":"2024-05-09T12:29:33.611158+0000","last_clean":"2024-05-09T12:29:33.611158+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:33.611158+0000","last_undegraded":"2024-05-09T12:29:33.611158+0000","last_fullsized":"2024-05-09T12:29:33.611158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:51:39.325653+0000","scrub_duration":0,"objects_trimmed":252,"snaptrim_duration":6.6119886640000001,"stat_sum":{"num_bytes":6640,"num_objects":426,"num_object_clones":212,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":426,"num_whiteouts":212,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.c","version":"32'1921","reported_seq":1973,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000094+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:29:27.000094+0000","last_peered":"2024-05-09T12:29:27.000094+0000","last_clean":"2024-05-09T12:29:27.000094+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:29:27.000094+0000","last_undegraded":"2024-05-09T12:29:27.000094+0000","last_fullsized":"2024-05-09T12:29:27.000094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:04.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"34'2671","reported_seq":2182,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.817804+0000","last_change":"2024-05-09T12:29:33.817804+0000","last_active":"2024-05-09T12:29:33.817804+0000","last_peered":"2024-05-09T12:29:33.817804+0000","last_clean":"2024-05-09T12:29:33.817804+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:29:33.817804+0000","last_undegraded":"2024-05-09T12:29:33.817804+0000","last_fullsized":"2024-05-09T12:29:33.817804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2671,"log_dups_size":0,"ondisk_log_size":2671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":233,"snaptrim_duration":6.8108003190000002,"stat_sum":{"num_bytes":2371,"num_objects":392,"num_object_clones":196,"num_object_copies":784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":392,"num_whiteouts":195,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.b","version":"32'4536","reported_seq":4588,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010258+0000","last_change":"2024-05-09T12:20:20.633689+0000","last_active":"2024-05-09T12:29:27.010258+0000","last_peered":"2024-05-09T12:29:27.010258+0000","last_clean":"2024-05-09T12:29:27.010258+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:27.010258+0000","last_undegraded":"2024-05-09T12:29:27.010258+0000","last_fullsized":"2024-05-09T12:29:27.010258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:45.084574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'2879","reported_seq":2310,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:32.530504+0000","last_change":"2024-05-09T12:29:32.530548+0000","last_active":"2024-05-09T12:29:32.530504+0000","last_peered":"2024-05-09T12:29:32.530504+0000","last_clean":"2024-05-09T12:29:32.530504+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:29:32.530504+0000","last_undegraded":"2024-05-09T12:29:32.530504+0000","last_fullsized":"2024-05-09T12:29:32.530504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:57:30.772589+0000","scrub_duration":0,"objects_trimmed":272,"snaptrim_duration":5.5307278330000003,"stat_sum":{"num_bytes":10784,"num_objects":436,"num_object_clones":217,"num_object_copies":872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.a","version":"32'3404","reported_seq":3456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999488+0000","last_change":"2024-05-09T12:20:20.632838+0000","last_active":"2024-05-09T12:29:26.999488+0000","last_peered":"2024-05-09T12:29:26.999488+0000","last_clean":"2024-05-09T12:29:26.999488+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:26.999488+0000","last_undegraded":"2024-05-09T12:29:26.999488+0000","last_fullsized":"2024-05-09T12:29:26.999488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:29:55.178957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2829","reported_seq":2305,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.081271+0000","last_change":"2024-05-09T12:29:36.081317+0000","last_active":"2024-05-09T12:29:36.081271+0000","last_peered":"2024-05-09T12:29:36.081271+0000","last_clean":"2024-05-09T12:29:36.081271+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:29:36.081271+0000","last_undegraded":"2024-05-09T12:29:36.081271+0000","last_fullsized":"2024-05-09T12:29:36.081271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:40.821593+0000","scrub_duration":0,"objects_trimmed":275,"snaptrim_duration":9.0817567009999998,"stat_sum":{"num_bytes":2532,"num_objects":422,"num_object_clones":211,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":211,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.9","version":"32'1855","reported_seq":1907,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000832+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:29:27.000832+0000","last_peered":"2024-05-09T12:29:27.000832+0000","last_clean":"2024-05-09T12:29:27.000832+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:29:27.000832+0000","last_undegraded":"2024-05-09T12:29:27.000832+0000","last_fullsized":"2024-05-09T12:29:27.000832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:16.404210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"34'3359","reported_seq":2682,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.314752+0000","last_change":"2024-05-09T12:29:36.314798+0000","last_active":"2024-05-09T12:29:36.314752+0000","last_peered":"2024-05-09T12:29:36.314752+0000","last_clean":"2024-05-09T12:29:36.314752+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:36.314752+0000","last_undegraded":"2024-05-09T12:29:36.314752+0000","last_fullsized":"2024-05-09T12:29:36.314752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:39:08.777335+0000","scrub_duration":0,"objects_trimmed":703,"snaptrim_duration":9.3147890400000009,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.8","version":"32'178","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021383+0000","last_change":"2024-05-09T12:20:20.634344+0000","last_active":"2024-05-09T12:29:27.021383+0000","last_peered":"2024-05-09T12:29:27.021383+0000","last_clean":"2024-05-09T12:29:27.021383+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:27.021383+0000","last_undegraded":"2024-05-09T12:29:27.021383+0000","last_fullsized":"2024-05-09T12:29:27.021383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"34'2988","reported_seq":2419,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.571472+0000","last_change":"2024-05-09T12:29:39.136736+0000","last_active":"2024-05-09T12:29:39.571472+0000","last_peered":"2024-05-09T12:29:39.571472+0000","last_clean":"2024-05-09T12:29:39.571472+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:39.571472+0000","last_undegraded":"2024-05-09T12:29:39.571472+0000","last_fullsized":"2024-05-09T12:29:39.571472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:06:19.334764+0000","scrub_duration":0,"objects_trimmed":446,"snaptrim_duration":5.8833810050000004,"stat_sum":{"num_bytes":5574,"num_objects":247,"num_object_clones":122,"num_object_copies":494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":122,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001317+0000","last_change":"2024-05-09T12:20:16.100233+0000","last_active":"2024-05-09T12:29:27.001317+0000","last_peered":"2024-05-09T12:29:27.001317+0000","last_clean":"2024-05-09T12:29:27.001317+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:27.001317+0000","last_undegraded":"2024-05-09T12:29:27.001317+0000","last_fullsized":"2024-05-09T12:29:27.001317+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:55.565641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'4944","reported_seq":4996,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.014781+0000","last_change":"2024-05-09T12:20:20.632910+0000","last_active":"2024-05-09T12:29:27.014781+0000","last_peered":"2024-05-09T12:29:27.014781+0000","last_clean":"2024-05-09T12:29:27.014781+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:27.014781+0000","last_undegraded":"2024-05-09T12:29:27.014781+0000","last_fullsized":"2024-05-09T12:29:27.014781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4944,"log_dups_size":0,"ondisk_log_size":4944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2824","reported_seq":2310,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.208133+0000","last_change":"2024-05-09T12:29:36.208177+0000","last_active":"2024-05-09T12:29:36.208133+0000","last_peered":"2024-05-09T12:29:36.208133+0000","last_clean":"2024-05-09T12:29:36.208133+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:29:36.208133+0000","last_undegraded":"2024-05-09T12:29:36.208133+0000","last_fullsized":"2024-05-09T12:29:36.208133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2824,"log_dups_size":0,"ondisk_log_size":2824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:10.321743+0000","scrub_duration":0,"objects_trimmed":261,"snaptrim_duration":9.2082448820000007,"stat_sum":{"num_bytes":2364,"num_objects":394,"num_object_clones":197,"num_object_copies":788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":394,"num_whiteouts":197,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000924+0000","last_change":"2024-05-09T12:20:16.100198+0000","last_active":"2024-05-09T12:29:27.000924+0000","last_peered":"2024-05-09T12:29:27.000924+0000","last_clean":"2024-05-09T12:29:27.000924+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:27.000924+0000","last_undegraded":"2024-05-09T12:29:27.000924+0000","last_fullsized":"2024-05-09T12:29:27.000924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:49:58.901846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'1013","reported_seq":1065,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999404+0000","last_change":"2024-05-09T12:20:20.632177+0000","last_active":"2024-05-09T12:29:26.999404+0000","last_peered":"2024-05-09T12:29:26.999404+0000","last_clean":"2024-05-09T12:29:26.999404+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:26.999404+0000","last_undegraded":"2024-05-09T12:29:26.999404+0000","last_fullsized":"2024-05-09T12:29:26.999404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:17.312136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'2767","reported_seq":2240,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.296739+0000","last_change":"2024-05-09T12:29:35.296776+0000","last_active":"2024-05-09T12:29:35.296739+0000","last_peered":"2024-05-09T12:29:35.296739+0000","last_clean":"2024-05-09T12:29:35.296739+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:35.296739+0000","last_undegraded":"2024-05-09T12:29:35.296739+0000","last_fullsized":"2024-05-09T12:29:35.296739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2767,"log_dups_size":0,"ondisk_log_size":2767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:04.684532+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":8.2806528900000007,"stat_sum":{"num_bytes":2484,"num_objects":414,"num_object_clones":207,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":207,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.2","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999376+0000","last_change":"2024-05-09T12:20:16.100587+0000","last_active":"2024-05-09T12:29:26.999376+0000","last_peered":"2024-05-09T12:29:26.999376+0000","last_clean":"2024-05-09T12:29:26.999376+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:26.999376+0000","last_undegraded":"2024-05-09T12:29:26.999376+0000","last_fullsized":"2024-05-09T12:29:26.999376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:01:30.271271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'4164","reported_seq":4216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021467+0000","last_change":"2024-05-09T12:20:20.634899+0000","last_active":"2024-05-09T12:29:27.021467+0000","last_peered":"2024-05-09T12:29:27.021467+0000","last_clean":"2024-05-09T12:29:27.021467+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:27.021467+0000","last_undegraded":"2024-05-09T12:29:27.021467+0000","last_fullsized":"2024-05-09T12:29:27.021467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:19.905806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2700","reported_seq":2202,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.486347+0000","last_change":"2024-05-09T12:29:35.486388+0000","last_active":"2024-05-09T12:29:35.486347+0000","last_peered":"2024-05-09T12:29:35.486347+0000","last_clean":"2024-05-09T12:29:35.486347+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:35.486347+0000","last_undegraded":"2024-05-09T12:29:35.486347+0000","last_fullsized":"2024-05-09T12:29:35.486347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2700,"log_dups_size":0,"ondisk_log_size":2700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":263,"snaptrim_duration":8.4637860039999993,"stat_sum":{"num_bytes":6604,"num_objects":422,"num_object_clones":209,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.3","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.010407+0000","last_change":"2024-05-09T12:20:15.589146+0000","last_active":"2024-05-09T12:29:27.010407+0000","last_peered":"2024-05-09T12:29:27.010407+0000","last_clean":"2024-05-09T12:29:27.010407+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:27.010407+0000","last_undegraded":"2024-05-09T12:29:27.010407+0000","last_fullsized":"2024-05-09T12:29:27.010407+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:05:29.070447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'72","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001224+0000","last_change":"2024-05-09T12:20:16.597972+0000","last_active":"2024-05-09T12:29:27.001224+0000","last_peered":"2024-05-09T12:29:27.001224+0000","last_clean":"2024-05-09T12:29:27.001224+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:27.001224+0000","last_undegraded":"2024-05-09T12:29:27.001224+0000","last_fullsized":"2024-05-09T12:29:27.001224+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:15.576416+0000","last_clean_scrub_stamp":"2024-05-09T12:20:15.576416+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:33.319559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2644","reported_seq":2827,"reported_epoch":34,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-09T12:29:39.515966+0000","last_change":"2024-05-09T12:29:39.515705+0000","last_active":"2024-05-09T12:29:39.515966+0000","last_peered":"2024-05-09T12:29:39.515966+0000","last_clean":"2024-05-09T12:29:39.515966+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:39.515966+0000","last_undegraded":"2024-05-09T12:29:39.515966+0000","last_fullsized":"2024-05-09T12:29:39.515966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2644,"log_dups_size":0,"ondisk_log_size":2644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"34'2830","reported_seq":2322,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.484479+0000","last_change":"2024-05-09T12:29:36.484479+0000","last_active":"2024-05-09T12:29:36.484479+0000","last_peered":"2024-05-09T12:29:36.484479+0000","last_clean":"2024-05-09T12:29:36.484479+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:36.484479+0000","last_undegraded":"2024-05-09T12:29:36.484479+0000","last_fullsized":"2024-05-09T12:29:36.484479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2830,"log_dups_size":0,"ondisk_log_size":2830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":9.4817268259999992,"stat_sum":{"num_bytes":6448,"num_objects":397,"num_object_clones":197,"num_object_copies":794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":397,"num_whiteouts":197,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.6","version":"34'1373","reported_seq":1426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:35.711327+0000","last_change":"2024-05-09T12:20:20.630564+0000","last_active":"2024-05-09T12:29:35.711327+0000","last_peered":"2024-05-09T12:29:35.711327+0000","last_clean":"2024-05-09T12:29:35.711327+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:35.711327+0000","last_undegraded":"2024-05-09T12:29:35.711327+0000","last_fullsized":"2024-05-09T12:29:35.711327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1373,"log_dups_size":0,"ondisk_log_size":1373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11350522,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":14192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016246+0000","last_change":"2024-05-09T12:20:15.586754+0000","last_active":"2024-05-09T12:29:27.016246+0000","last_peered":"2024-05-09T12:29:27.016246+0000","last_clean":"2024-05-09T12:29:27.016246+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:27.016246+0000","last_undegraded":"2024-05-09T12:29:27.016246+0000","last_fullsized":"2024-05-09T12:29:27.016246+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'3061","reported_seq":2445,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.901269+0000","last_change":"2024-05-09T12:29:37.901308+0000","last_active":"2024-05-09T12:29:37.901269+0000","last_peered":"2024-05-09T12:29:37.901269+0000","last_clean":"2024-05-09T12:29:37.901269+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:37.901269+0000","last_undegraded":"2024-05-09T12:29:37.901269+0000","last_fullsized":"2024-05-09T12:29:37.901269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3061,"log_dups_size":0,"ondisk_log_size":3061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:09:19.316126+0000","scrub_duration":0,"objects_trimmed":661,"snaptrim_duration":10.900060073000001,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.7","version":"32'26","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.023253+0000","last_change":"2024-05-09T12:20:20.635145+0000","last_active":"2024-05-09T12:29:27.023253+0000","last_peered":"2024-05-09T12:29:27.023253+0000","last_clean":"2024-05-09T12:29:27.023253+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:27.023253+0000","last_undegraded":"2024-05-09T12:29:27.023253+0000","last_fullsized":"2024-05-09T12:29:27.023253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.842911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001252+0000","last_change":"2024-05-09T12:20:16.100245+0000","last_active":"2024-05-09T12:29:27.001252+0000","last_peered":"2024-05-09T12:29:27.001252+0000","last_clean":"2024-05-09T12:29:27.001252+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:27.001252+0000","last_undegraded":"2024-05-09T12:29:27.001252+0000","last_fullsized":"2024-05-09T12:29:27.001252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:02:35.320819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"34'3326","reported_seq":2637,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:38.423360+0000","last_change":"2024-05-09T12:29:38.423360+0000","last_active":"2024-05-09T12:29:38.423360+0000","last_peered":"2024-05-09T12:29:38.423360+0000","last_clean":"2024-05-09T12:29:38.423360+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:38.423360+0000","last_undegraded":"2024-05-09T12:29:38.423360+0000","last_fullsized":"2024-05-09T12:29:38.423360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":534,"snaptrim_duration":11.417619044,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.4","version":"32'27","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.016161+0000","last_change":"2024-05-09T12:20:20.633703+0000","last_active":"2024-05-09T12:29:27.016161+0000","last_peered":"2024-05-09T12:29:27.016161+0000","last_clean":"2024-05-09T12:29:27.016161+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:27.016161+0000","last_undegraded":"2024-05-09T12:29:27.016161+0000","last_fullsized":"2024-05-09T12:29:27.016161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001385+0000","last_change":"2024-05-09T12:20:16.100160+0000","last_active":"2024-05-09T12:29:27.001385+0000","last_peered":"2024-05-09T12:29:27.001385+0000","last_clean":"2024-05-09T12:29:27.001385+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:27.001385+0000","last_undegraded":"2024-05-09T12:29:27.001385+0000","last_fullsized":"2024-05-09T12:29:27.001385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:35.303552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"34'3037","reported_seq":2489,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.264674+0000","last_change":"2024-05-09T12:29:35.264674+0000","last_active":"2024-05-09T12:29:35.264674+0000","last_peered":"2024-05-09T12:29:35.264674+0000","last_clean":"2024-05-09T12:29:35.264674+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:35.264674+0000","last_undegraded":"2024-05-09T12:29:35.264674+0000","last_fullsized":"2024-05-09T12:29:35.264674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3037,"log_dups_size":0,"ondisk_log_size":3037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":299,"snaptrim_duration":8.2575020559999999,"stat_sum":{"num_bytes":2580,"num_objects":432,"num_object_clones":215,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.5","version":"32'2124","reported_seq":2176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000878+0000","last_change":"2024-05-09T12:20:20.632163+0000","last_active":"2024-05-09T12:29:27.000878+0000","last_peered":"2024-05-09T12:29:27.000878+0000","last_clean":"2024-05-09T12:29:27.000878+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:27.000878+0000","last_undegraded":"2024-05-09T12:29:27.000878+0000","last_fullsized":"2024-05-09T12:29:27.000878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999956+0000","last_change":"2024-05-09T12:20:15.589872+0000","last_active":"2024-05-09T12:29:26.999956+0000","last_peered":"2024-05-09T12:29:26.999956+0000","last_clean":"2024-05-09T12:29:26.999956+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:26.999956+0000","last_undegraded":"2024-05-09T12:29:26.999956+0000","last_fullsized":"2024-05-09T12:29:26.999956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:14.569659+0000","last_clean_scrub_stamp":"2024-05-09T12:20:14.569659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:55:12.339524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"34'3058","reported_seq":2480,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.566200+0000","last_change":"2024-05-09T12:29:39.566239+0000","last_active":"2024-05-09T12:29:39.566200+0000","last_peered":"2024-05-09T12:29:39.566200+0000","last_clean":"2024-05-09T12:29:39.566200+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:39.566200+0000","last_undegraded":"2024-05-09T12:29:39.566200+0000","last_fullsized":"2024-05-09T12:29:39.566200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:54:49.330336+0000","scrub_duration":0,"objects_trimmed":659,"snaptrim_duration":12.551403464,"stat_sum":{"num_bytes":8203,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.13","version":"34'2835","reported_seq":2279,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.519646+0000","last_change":"2024-05-09T12:29:34.519684+0000","last_active":"2024-05-09T12:29:34.519646+0000","last_peered":"2024-05-09T12:29:34.519646+0000","last_clean":"2024-05-09T12:29:34.519646+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:34.519646+0000","last_undegraded":"2024-05-09T12:29:34.519646+0000","last_fullsized":"2024-05-09T12:29:34.519646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:51.710645+0000","scrub_duration":0,"objects_trimmed":286,"snaptrim_duration":7.5203377620000005,"stat_sum":{"num_bytes":2592,"num_objects":434,"num_object_clones":216,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.14","version":"34'5456","reported_seq":5507,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000046+0000","last_change":"2024-05-09T12:20:20.634111+0000","last_active":"2024-05-09T12:29:27.000046+0000","last_peered":"2024-05-09T12:29:27.000046+0000","last_clean":"2024-05-09T12:29:27.000046+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:27.000046+0000","last_undegraded":"2024-05-09T12:29:27.000046+0000","last_fullsized":"2024-05-09T12:29:27.000046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5456,"log_dups_size":0,"ondisk_log_size":5456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:55.770732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"34'3160","reported_seq":2555,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.136675+0000","last_change":"2024-05-09T12:29:39.136717+0000","last_active":"2024-05-09T12:29:39.136675+0000","last_peered":"2024-05-09T12:29:39.136675+0000","last_clean":"2024-05-09T12:29:39.136675+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:39.136675+0000","last_undegraded":"2024-05-09T12:29:39.136675+0000","last_fullsized":"2024-05-09T12:29:39.136675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3160,"log_dups_size":0,"ondisk_log_size":3160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:18.991011+0000","scrub_duration":0,"objects_trimmed":663,"snaptrim_duration":12.122126239,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.15","version":"34'3054","reported_seq":3105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000825+0000","last_change":"2024-05-09T12:20:20.632102+0000","last_active":"2024-05-09T12:29:27.000825+0000","last_peered":"2024-05-09T12:29:27.000825+0000","last_clean":"2024-05-09T12:29:27.000825+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:27.000825+0000","last_undegraded":"2024-05-09T12:29:27.000825+0000","last_fullsized":"2024-05-09T12:29:27.000825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3054,"log_dups_size":0,"ondisk_log_size":3054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:40.182782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"32'3359","reported_seq":3410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.000042+0000","last_change":"2024-05-09T12:20:20.632628+0000","last_active":"2024-05-09T12:29:27.000042+0000","last_peered":"2024-05-09T12:29:27.000042+0000","last_clean":"2024-05-09T12:29:27.000042+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:27.000042+0000","last_undegraded":"2024-05-09T12:29:27.000042+0000","last_fullsized":"2024-05-09T12:29:27.000042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"34'3404","reported_seq":2714,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:39.195525+0000","last_change":"2024-05-09T12:29:39.195572+0000","last_active":"2024-05-09T12:29:39.195525+0000","last_peered":"2024-05-09T12:29:39.195525+0000","last_clean":"2024-05-09T12:29:39.195525+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:39.195525+0000","last_undegraded":"2024-05-09T12:29:39.195525+0000","last_fullsized":"2024-05-09T12:29:39.195525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3404,"log_dups_size":0,"ondisk_log_size":3404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":671,"snaptrim_duration":12.186447082000001,"stat_sum":{"num_bytes":121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.17","version":"32'1016","reported_seq":1068,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003814+0000","last_change":"2024-05-09T12:20:20.632487+0000","last_active":"2024-05-09T12:29:27.003814+0000","last_peered":"2024-05-09T12:29:27.003814+0000","last_clean":"2024-05-09T12:29:27.003814+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:27.003814+0000","last_undegraded":"2024-05-09T12:29:27.003814+0000","last_fullsized":"2024-05-09T12:29:27.003814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'3310","reported_seq":2667,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:36.417487+0000","last_change":"2024-05-09T12:29:36.417527+0000","last_active":"2024-05-09T12:29:36.417487+0000","last_peered":"2024-05-09T12:29:36.417487+0000","last_clean":"2024-05-09T12:29:36.417487+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:29:36.417487+0000","last_undegraded":"2024-05-09T12:29:36.417487+0000","last_fullsized":"2024-05-09T12:29:36.417487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3310,"log_dups_size":0,"ondisk_log_size":3310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:32.548384+0000","scrub_duration":0,"objects_trimmed":438,"snaptrim_duration":9.3962072110000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"4.1f","version":"34'2639","reported_seq":2171,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:33.975543+0000","last_change":"2024-05-09T12:29:33.975591+0000","last_active":"2024-05-09T12:29:33.975543+0000","last_peered":"2024-05-09T12:29:33.975543+0000","last_clean":"2024-05-09T12:29:33.975543+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:29:33.975543+0000","last_undegraded":"2024-05-09T12:29:33.975543+0000","last_fullsized":"2024-05-09T12:29:33.975543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2639,"log_dups_size":0,"ondisk_log_size":2639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:46.097338+0000","scrub_duration":0,"objects_trimmed":260,"snaptrim_duration":6.975877466,"stat_sum":{"num_bytes":2400,"num_objects":401,"num_object_clones":200,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":200,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.18","version":"32'2400","reported_seq":2451,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.021261+0000","last_change":"2024-05-09T12:20:20.635134+0000","last_active":"2024-05-09T12:29:27.021261+0000","last_peered":"2024-05-09T12:29:27.021261+0000","last_clean":"2024-05-09T12:29:27.021261+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:27.021261+0000","last_undegraded":"2024-05-09T12:29:27.021261+0000","last_fullsized":"2024-05-09T12:29:27.021261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2400,"log_dups_size":0,"ondisk_log_size":2400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:02.275181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'2742","reported_seq":2245,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:37.493416+0000","last_change":"2024-05-09T12:29:37.493416+0000","last_active":"2024-05-09T12:29:37.493416+0000","last_peered":"2024-05-09T12:29:37.493416+0000","last_clean":"2024-05-09T12:29:37.493416+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:37.493416+0000","last_undegraded":"2024-05-09T12:29:37.493416+0000","last_fullsized":"2024-05-09T12:29:37.493416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":254,"snaptrim_duration":10.490770571000001,"stat_sum":{"num_bytes":6376,"num_objects":382,"num_object_clones":190,"num_object_copies":764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":382,"num_whiteouts":190,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.19","version":"32'762","reported_seq":813,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.011836+0000","last_change":"2024-05-09T12:20:20.633133+0000","last_active":"2024-05-09T12:29:27.011836+0000","last_peered":"2024-05-09T12:29:27.011836+0000","last_clean":"2024-05-09T12:29:27.011836+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:27.011836+0000","last_undegraded":"2024-05-09T12:29:27.011836+0000","last_fullsized":"2024-05-09T12:29:27.011836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:37:34.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2757","reported_seq":2253,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.093619+0000","last_change":"2024-05-09T12:29:31.093619+0000","last_active":"2024-05-09T12:29:31.093619+0000","last_peered":"2024-05-09T12:29:31.093619+0000","last_clean":"2024-05-09T12:29:31.093619+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:31.093619+0000","last_undegraded":"2024-05-09T12:29:31.093619+0000","last_fullsized":"2024-05-09T12:29:31.093619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2757,"log_dups_size":0,"ondisk_log_size":2757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":4.0889008630000001,"stat_sum":{"num_bytes":2424,"num_objects":405,"num_object_clones":202,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":405,"num_whiteouts":202,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1a","version":"32'6247","reported_seq":6298,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999456+0000","last_change":"2024-05-09T12:20:20.632739+0000","last_active":"2024-05-09T12:29:26.999456+0000","last_peered":"2024-05-09T12:29:26.999456+0000","last_clean":"2024-05-09T12:29:26.999456+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:26.999456+0000","last_undegraded":"2024-05-09T12:29:26.999456+0000","last_fullsized":"2024-05-09T12:29:26.999456+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5947,"log_dups_size":0,"ondisk_log_size":5947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:51.893719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"34'3116","reported_seq":2511,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.566134+0000","last_change":"2024-05-09T12:29:39.566169+0000","last_active":"2024-05-09T12:29:39.566134+0000","last_peered":"2024-05-09T12:29:39.566134+0000","last_clean":"2024-05-09T12:29:39.566134+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:39.566134+0000","last_undegraded":"2024-05-09T12:29:39.566134+0000","last_fullsized":"2024-05-09T12:29:39.566134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3116,"log_dups_size":0,"ondisk_log_size":3116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:17:38.392357+0000","scrub_duration":0,"objects_trimmed":300,"snaptrim_duration":7.2311749589999996,"stat_sum":{"num_bytes":2880,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1b","version":"32'3295","reported_seq":3347,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.007261+0000","last_change":"2024-05-09T12:20:20.628013+0000","last_active":"2024-05-09T12:29:27.007261+0000","last_peered":"2024-05-09T12:29:27.007261+0000","last_clean":"2024-05-09T12:29:27.007261+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:27.007261+0000","last_undegraded":"2024-05-09T12:29:27.007261+0000","last_fullsized":"2024-05-09T12:29:27.007261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":3295,"log_dups_size":0,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2703","reported_seq":2173,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:35.473658+0000","last_change":"2024-05-09T12:29:35.473680+0000","last_active":"2024-05-09T12:29:35.473658+0000","last_peered":"2024-05-09T12:29:35.473658+0000","last_clean":"2024-05-09T12:29:35.473658+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:35.473658+0000","last_undegraded":"2024-05-09T12:29:35.473658+0000","last_fullsized":"2024-05-09T12:29:35.473658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2703,"log_dups_size":0,"ondisk_log_size":2703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:45.377609+0000","scrub_duration":0,"objects_trimmed":271,"snaptrim_duration":8.4745913399999999,"stat_sum":{"num_bytes":2676,"num_objects":446,"num_object_clones":223,"num_object_copies":892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":446,"num_whiteouts":223,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1c","version":"32'626","reported_seq":677,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:26.999266+0000","last_change":"2024-05-09T12:20:20.631998+0000","last_active":"2024-05-09T12:29:26.999266+0000","last_peered":"2024-05-09T12:29:26.999266+0000","last_clean":"2024-05-09T12:29:26.999266+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:26.999266+0000","last_undegraded":"2024-05-09T12:29:26.999266+0000","last_fullsized":"2024-05-09T12:29:26.999266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:01.382021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'2973","reported_seq":2389,"reported_epoch":34,"state":"active+clean+snaptrim","last_fresh":"2024-05-09T12:29:39.505795+0000","last_change":"2024-05-09T12:29:39.135794+0000","last_active":"2024-05-09T12:29:39.505795+0000","last_peered":"2024-05-09T12:29:39.505795+0000","last_clean":"2024-05-09T12:29:39.505795+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:29:39.505795+0000","last_undegraded":"2024-05-09T12:29:39.505795+0000","last_fullsized":"2024-05-09T12:29:39.505795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2973,"log_dups_size":0,"ondisk_log_size":2973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:40:14.900147+0000","scrub_duration":0,"objects_trimmed":453,"snaptrim_duration":5.8993531350000001,"stat_sum":{"num_bytes":1356,"num_objects":227,"num_object_clones":113,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":113,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1d","version":"32'8181","reported_seq":8232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.001864+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:29:27.001864+0000","last_peered":"2024-05-09T12:29:27.001864+0000","last_clean":"2024-05-09T12:29:27.001864+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:29:27.001864+0000","last_undegraded":"2024-05-09T12:29:27.001864+0000","last_fullsized":"2024-05-09T12:29:27.001864+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:16:46.721280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'2684","reported_seq":2183,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:31.284327+0000","last_change":"2024-05-09T12:29:31.284327+0000","last_active":"2024-05-09T12:29:31.284327+0000","last_peered":"2024-05-09T12:29:31.284327+0000","last_clean":"2024-05-09T12:29:31.284327+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:31.284327+0000","last_undegraded":"2024-05-09T12:29:31.284327+0000","last_fullsized":"2024-05-09T12:29:31.284327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2684,"log_dups_size":0,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":239,"snaptrim_duration":4.2753868710000003,"stat_sum":{"num_bytes":2340,"num_objects":391,"num_object_clones":195,"num_object_copies":782,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":391,"num_whiteouts":195,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1e","version":"32'5552","reported_seq":5605,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.002734+0000","last_change":"2024-05-09T12:20:20.627589+0000","last_active":"2024-05-09T12:29:27.002734+0000","last_peered":"2024-05-09T12:29:27.002734+0000","last_clean":"2024-05-09T12:29:27.002734+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:27.002734+0000","last_undegraded":"2024-05-09T12:29:27.002734+0000","last_fullsized":"2024-05-09T12:29:27.002734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5552,"log_dups_size":0,"ondisk_log_size":5552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"34'3289","reported_seq":2637,"reported_epoch":34,"state":"active+clean+snaptrim_wait","last_fresh":"2024-05-09T12:29:34.346746+0000","last_change":"2024-05-09T12:29:34.346786+0000","last_active":"2024-05-09T12:29:34.346746+0000","last_peered":"2024-05-09T12:29:34.346746+0000","last_clean":"2024-05-09T12:29:34.346746+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:34.346746+0000","last_undegraded":"2024-05-09T12:29:34.346746+0000","last_fullsized":"2024-05-09T12:29:34.346746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3289,"log_dups_size":0,"ondisk_log_size":3289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:41:38.978431+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":7.3450994969999996,"stat_sum":{"num_bytes":2951,"num_objects":494,"num_object_clones":246,"num_object_copies":988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":494,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.1f","version":"32'2436","reported_seq":2489,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-09T12:29:27.003531+0000","last_change":"2024-05-09T12:20:20.632703+0000","last_active":"2024-05-09T12:29:27.003531+0000","last_peered":"2024-05-09T12:29:27.003531+0000","last_clean":"2024-05-09T12:29:27.003531+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:27.003531+0000","last_undegraded":"2024-05-09T12:29:27.003531+0000","last_fullsized":"2024-05-09T12:29:27.003531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":2436,"log_dups_size":0,"ondisk_log_size":2436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":209243,"num_objects":13797,"num_object_clones":6845,"num_object_copies":27594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13797,"num_whiteouts":6837,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56111104,"data_stored":417776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195088,"ondisk_log_size":195088,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287136858,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87026,"num_write_kb":575472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574341120,"data_stored":574273716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82351,"ondisk_log_size":82351,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705780,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":764292,"kb_used_data":129212,"kb_used_omap":1,"kb_used_meta":635070,"kb_avail":93607548,"statfs":{"total":96636764160,"available":95854129152,"internally_reserved":0,"allocated":132313088,"data_stored":118287027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":650312135},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705780,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":949088,"kb_used_data":182100,"kb_used_omap":1,"kb_used_meta":766974,"kb_avail":93422752,"statfs":{"total":96636764160,"available":95664898048,"internally_reserved":0,"allocated":186470400,"data_stored":175360117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":785381829},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705782,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":587080,"kb_used_data":122812,"kb_used_omap":1,"kb_used_meta":464254,"kb_avail":93784760,"statfs":{"total":96636764160,"available":96035594240,"internally_reserved":0,"allocated":125759488,"data_stored":108657269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":475396549},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":807772,"kb_used_data":186644,"kb_used_omap":1,"kb_used_meta":621118,"kb_avail":93564068,"statfs":{"total":96636764160,"available":95809605632,"internally_reserved":0,"allocated":191123456,"data_stored":174120615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":636025285},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173907968,"data_stored":173889922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107823104,"data_stored":107819514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16674816,"data_stored":93858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16789504,"data_stored":110516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9367552,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":116507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:29:41.598 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.598 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.598 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.598 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.599 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.600 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.601 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.602 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.603 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.604 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.605 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T12:20:15.576416+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.606 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-05-09T12:20:14.569659+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.607 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.608 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.609 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:29:41.610 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T12:30:01.611 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:30:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.711+0000 7f5a6e4bc640 1 Processor -- start 2024-05-09T12:30:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.711+0000 7f5a6e4bc640 1 -- start start 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a6e4bc640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5a6813ac70 0x7f5a6813b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a6e4bc640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a68073be0 con 0x7f5a6809ba30 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a6e4bc640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a68073ec0 con 0x7f5a6809c5f0 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a6e4bc640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f5a68072db0 con 0x7f5a6813ac70 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a677fe640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5a6809ba30 0x7f5a6809bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47184/0 (socket says 172.21.15.135:47184) 2024-05-09T12:30:01.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a677fe640 1 -- 172.21.15.135:0/2028202801 learned_addr learned my addr 172.21.15.135:0/2028202801 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a67fff640 1 --2- 172.21.15.135:0/2028202801 >> v2:172.21.15.160:3300/0 conn(0x7f5a6813ac70 0x7f5a6813b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494245478 0 0) 0x7f5a68073be0 con 0x7f5a6809ba30 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a54003520 con 0x7f5a6809ba30 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414532627 0 0) 0x7f5a68073ec0 con 0x7f5a6809c5f0 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a68073be0 con 0x7f5a6809c5f0 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3923678355 0 0) 0x7f5a54003520 con 0x7f5a6809ba30 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 >> v2:172.21.15.160:3300/0 conn(0x7f5a6813ac70 msgr2=0x7f5a6813b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 --2- 172.21.15.135:0/2028202801 >> v2:172.21.15.160:3300/0 conn(0x7f5a6813ac70 0x7f5a6813b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 >> v1:172.21.15.160:6789/0 conn(0x7f5a6809c5f0 legacy=0x7f5a681428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a680735e0 con 0x7f5a6809ba30 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7f5a500016f0 con 0x7f5a6809ba30 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 >> v1:172.21.15.135:6789/0 conn(0x7f5a6809ba30 legacy=0x7f5a6809bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a54003c30 0x7f5a54004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a54005390 0x7f5a5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68072db0 con 0x7f5a54004800 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5400c280 con 0x7f5a54003c30 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.712+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5400c480 con 0x7f5a54005390 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a67fff640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a54003c30 0x7f5a54004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a6ca59640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a54005390 0x7f5a5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 -- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a54005390 msgr2=0x7f5a5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a54005390 0x7f5a5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 -- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a54003c30 msgr2=0x7f5a54004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a54003c30 0x7f5a54004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a6ca59640 1 -- 172.21.15.135:0/2028202801 reap_dead start 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.713+0000 7f5a677fe640 1 -- 172.21.15.135:0/2028202801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a54003520 con 0x7f5a54004800 2024-05-09T12:30:01.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a677fe640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c190 tx=0x7f5a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1649c4a4b0f39f36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50007cc0 con 0x7f5a54004800 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50030070 con 0x7f5a54004800 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a66ffd640 1 -- 172.21.15.135:0/2028202801 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50005d50 con 0x7f5a54004800 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 msgr2=0x7f5a54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c190 tx=0x7f5a54005830 comp rx=0 tx=0).stop 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/2028202801 shutdown_connections 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/2028202801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a54004c80 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/2028202801 >> 172.21.15.135:0/2028202801 conn(0x7f5a680aa930 msgr2=0x7f5a680aad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/2028202801 shutdown_connections 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.714+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/2028202801 wait complete. 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.715+0000 7f5a6e4bc640 1 Processor -- start 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.715+0000 7f5a6e4bc640 1 -- start start 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a681cf040 0x7f5a681d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a681cf4a0 0x7f5a681d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68072970 con 0x7f5a54004800 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68070370 con 0x7f5a681cf040 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6e4bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6809cee0 con 0x7f5a681cf4a0 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54274/0 (socket says 172.21.15.135:54274) 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 -- 172.21.15.135:0/1368455194 learned_addr learned my addr 172.21.15.135:0/1368455194 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a677fe640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a681cf040 0x7f5a681d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a6ca59640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a681cf4a0 0x7f5a681d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 -- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a681cf4a0 msgr2=0x7f5a681d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a681cf4a0 0x7f5a681d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 -- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a681cf040 msgr2=0x7f5a681d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a681cf040 0x7f5a681d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 -- 172.21.15.135:0/1368455194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a68072740 con 0x7f5a54004800 2024-05-09T12:30:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.716+0000 7f5a67fff640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f5a58011990 tx=0x7f5a58011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.717+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800fad0 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.717+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5800fc70 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.717+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a680a6dc0 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.717+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58014440 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.717+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a680a7080 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.718+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a680508d0 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.718+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a58012040 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.719+0000 7f5a64ff9640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 0x7f5a48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.719+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7f5a58097570 con 0x7f5a54004800 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.719+0000 7f5a677fe640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 0x7f5a48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:01.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.719+0000 7f5a677fe640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 0x7f5a48078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a50034000 tx=0x7f5a50009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:01.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.723+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a58019030 con 0x7f5a54004800 2024-05-09T12:30:01.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.905+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a68070150 con 0x7f5a480762d0 2024-05-09T12:30:01.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.912+0000 7f5a64ff9640 1 -- 172.21.15.135:0/1368455194 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+271405 (secure 0 0 0) 0x7f5a68070150 con 0x7f5a480762d0 2024-05-09T12:30:01.916 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:30:01.917 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:30:01.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 msgr2=0x7f5a48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 0x7f5a48078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a50034000 tx=0x7f5a50009030 comp rx=0 tx=0).stop 2024-05-09T12:30:01.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 msgr2=0x7f5a681ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:01.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f5a58011990 tx=0x7f5a58011e50 comp rx=0 tx=0).stop 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 shutdown_connections 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f5a480762d0 0x7f5a48078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a681cf4a0 0x7f5a681d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a681cf040 0x7f5a681d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 --2- 172.21.15.135:0/1368455194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54004800 0x7f5a681ceb00 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 >> 172.21.15.135:0/1368455194 conn(0x7f5a680aa930 msgr2=0x7f5a68137740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 shutdown_connections 2024-05-09T12:30:01.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:01.915+0000 7f5a6e4bc640 1 -- 172.21.15.135:0/1368455194 wait complete. 2024-05-09T12:30:01.927 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-09T12:30:01.489895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":287854569,"num_objects":266,"num_object_clones":20,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":12,"num_read":255,"num_read_kb":3256,"num_write":164635,"num_write_kb":617697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4194062,"num_omap_keys":8322,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291353,"ondisk_log_size":291353,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3149960,"kb_used_data":563944,"kb_used_omap":6,"kb_used_meta":2585977,"kb_avail":374337400,"statfs":{"total":386547056640,"available":383321497600,"internally_reserved":0,"allocated":577478656,"data_stored":576291676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2648041238},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2754382,"num_omap_keys":5464,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001652"},"pg_stats":[{"pgid":"4.3f","version":"34'3050","reported_seq":2472,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509397+0000","last_change":"2024-05-09T12:29:44.868240+0000","last_active":"2024-05-09T12:29:55.509397+0000","last_peered":"2024-05-09T12:29:55.509397+0000","last_clean":"2024-05-09T12:29:55.509397+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:29:55.509397+0000","last_undegraded":"2024-05-09T12:29:55.509397+0000","last_fullsized":"2024-05-09T12:29:55.509397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":622,"snaptrim_duration":17.864578351999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"34'3197","reported_seq":2599,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935396+0000","last_change":"2024-05-09T12:29:41.256755+0000","last_active":"2024-05-09T12:29:54.935396+0000","last_peered":"2024-05-09T12:29:54.935396+0000","last_clean":"2024-05-09T12:29:54.935396+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:29:54.935396+0000","last_undegraded":"2024-05-09T12:29:54.935396+0000","last_fullsized":"2024-05-09T12:29:54.935396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":448,"snaptrim_duration":14.256971752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'3285","reported_seq":2713,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934614+0000","last_change":"2024-05-09T12:29:54.498844+0000","last_active":"2024-05-09T12:29:54.934614+0000","last_peered":"2024-05-09T12:29:54.934614+0000","last_clean":"2024-05-09T12:29:54.934614+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:54.934614+0000","last_undegraded":"2024-05-09T12:29:54.934614+0000","last_fullsized":"2024-05-09T12:29:54.934614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3285","last_scrub_stamp":"2024-05-09T12:29:54.498724+0000","last_deep_scrub":"35'3285","last_deep_scrub_stamp":"2024-05-09T12:29:54.498724+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.498724+0000","objects_scrubbed":2,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:35.834479+0000","scrub_duration":6,"objects_trimmed":663,"snaptrim_duration":16.553678722000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'3472","reported_seq":2780,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936036+0000","last_change":"2024-05-09T12:29:41.258329+0000","last_active":"2024-05-09T12:29:54.936036+0000","last_peered":"2024-05-09T12:29:54.936036+0000","last_clean":"2024-05-09T12:29:54.936036+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:29:54.936036+0000","last_undegraded":"2024-05-09T12:29:54.936036+0000","last_fullsized":"2024-05-09T12:29:54.936036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":735,"snaptrim_duration":14.259408158999999,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'3385","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.547563+0000","last_change":"2024-05-09T12:29:58.547589+0000","last_active":"2024-05-09T12:29:58.547563+0000","last_peered":"2024-05-09T12:29:58.547563+0000","last_clean":"2024-05-09T12:29:58.547563+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:58.547563+0000","last_undegraded":"2024-05-09T12:29:58.547563+0000","last_fullsized":"2024-05-09T12:29:58.547563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3385","last_scrub_stamp":"2024-05-09T12:29:58.547504+0000","last_deep_scrub":"36'3385","last_deep_scrub_stamp":"2024-05-09T12:29:58.547504+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.547504+0000","objects_scrubbed":2,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:44:10.420698+0000","scrub_duration":5,"objects_trimmed":690,"snaptrim_duration":17.859802576,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"35'3341","reported_seq":2742,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935135+0000","last_change":"2024-05-09T12:29:47.517358+0000","last_active":"2024-05-09T12:29:54.935135+0000","last_peered":"2024-05-09T12:29:54.935135+0000","last_clean":"2024-05-09T12:29:54.935135+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:54.935135+0000","last_undegraded":"2024-05-09T12:29:54.935135+0000","last_fullsized":"2024-05-09T12:29:54.935135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3341","last_scrub_stamp":"2024-05-09T12:29:47.517225+0000","last_deep_scrub":"35'3341","last_deep_scrub_stamp":"2024-05-09T12:29:47.517225+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.517225+0000","objects_scrubbed":4,"log_size":3341,"log_dups_size":0,"ondisk_log_size":3341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:59.845930+0000","scrub_duration":9,"objects_trimmed":688,"snaptrim_duration":16.547100930999999,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"34'3248","reported_seq":2655,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933799+0000","last_change":"2024-05-09T12:29:43.540624+0000","last_active":"2024-05-09T12:29:54.933799+0000","last_peered":"2024-05-09T12:29:54.933799+0000","last_clean":"2024-05-09T12:29:54.933799+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:29:54.933799+0000","last_undegraded":"2024-05-09T12:29:54.933799+0000","last_fullsized":"2024-05-09T12:29:54.933799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3248,"log_dups_size":0,"ondisk_log_size":3248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":448,"snaptrim_duration":16.540123852000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"35'3148","reported_seq":2561,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934878+0000","last_change":"2024-05-09T12:29:49.489533+0000","last_active":"2024-05-09T12:29:54.934878+0000","last_peered":"2024-05-09T12:29:54.934878+0000","last_clean":"2024-05-09T12:29:54.934878+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:54.934878+0000","last_undegraded":"2024-05-09T12:29:54.934878+0000","last_fullsized":"2024-05-09T12:29:54.934878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3148","last_scrub_stamp":"2024-05-09T12:29:49.489397+0000","last_deep_scrub":"35'3148","last_deep_scrub_stamp":"2024-05-09T12:29:49.489397+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.489397+0000","objects_scrubbed":3,"log_size":3148,"log_dups_size":0,"ondisk_log_size":3148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:30.756978+0000","scrub_duration":8,"objects_trimmed":466,"snaptrim_duration":16.541869661,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'3367","reported_seq":2752,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.511899+0000","last_change":"2024-05-09T12:29:56.511950+0000","last_active":"2024-05-09T12:29:56.511899+0000","last_peered":"2024-05-09T12:29:56.511899+0000","last_clean":"2024-05-09T12:29:56.511899+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:56.511899+0000","last_undegraded":"2024-05-09T12:29:56.511899+0000","last_fullsized":"2024-05-09T12:29:56.511899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3367","last_scrub_stamp":"2024-05-09T12:29:56.511821+0000","last_deep_scrub":"36'3367","last_deep_scrub_stamp":"2024-05-09T12:29:56.511821+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.511821+0000","objects_scrubbed":4,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:49:17.197397+0000","scrub_duration":8,"objects_trimmed":674,"snaptrim_duration":17.862469918999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'2898","reported_seq":2364,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936528+0000","last_change":"2024-05-09T12:29:43.548673+0000","last_active":"2024-05-09T12:29:54.936528+0000","last_peered":"2024-05-09T12:29:54.936528+0000","last_clean":"2024-05-09T12:29:54.936528+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:29:54.936528+0000","last_undegraded":"2024-05-09T12:29:54.936528+0000","last_fullsized":"2024-05-09T12:29:54.936528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":613,"snaptrim_duration":16.547575371000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'2981","reported_seq":2434,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934510+0000","last_change":"2024-05-09T12:29:49.140218+0000","last_active":"2024-05-09T12:29:54.934510+0000","last_peered":"2024-05-09T12:29:54.934510+0000","last_clean":"2024-05-09T12:29:54.934510+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:54.934510+0000","last_undegraded":"2024-05-09T12:29:54.934510+0000","last_fullsized":"2024-05-09T12:29:54.934510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2981","last_scrub_stamp":"2024-05-09T12:29:49.140089+0000","last_deep_scrub":"35'2981","last_deep_scrub_stamp":"2024-05-09T12:29:49.140089+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.140089+0000","objects_scrubbed":4,"log_size":2981,"log_dups_size":0,"ondisk_log_size":2981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.048807+0000","scrub_duration":8,"objects_trimmed":419,"snaptrim_duration":14.254656912,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"35'3185","reported_seq":2564,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934781+0000","last_change":"2024-05-09T12:29:53.514723+0000","last_active":"2024-05-09T12:29:54.934781+0000","last_peered":"2024-05-09T12:29:54.934781+0000","last_clean":"2024-05-09T12:29:54.934781+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:54.934781+0000","last_undegraded":"2024-05-09T12:29:54.934781+0000","last_fullsized":"2024-05-09T12:29:54.934781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3185","last_scrub_stamp":"2024-05-09T12:29:53.514590+0000","last_deep_scrub":"35'3185","last_deep_scrub_stamp":"2024-05-09T12:29:53.514590+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.514590+0000","objects_scrubbed":6,"log_size":3185,"log_dups_size":0,"ondisk_log_size":3185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:03.423309+0000","scrub_duration":9,"objects_trimmed":714,"snaptrim_duration":15.32309437,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3241","reported_seq":2665,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508009+0000","last_change":"2024-05-09T12:29:44.861183+0000","last_active":"2024-05-09T12:29:55.508009+0000","last_peered":"2024-05-09T12:29:55.508009+0000","last_clean":"2024-05-09T12:29:55.508009+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:29:55.508009+0000","last_undegraded":"2024-05-09T12:29:55.508009+0000","last_fullsized":"2024-05-09T12:29:55.508009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3241,"log_dups_size":0,"ondisk_log_size":3241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":621,"snaptrim_duration":17.854655624999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"35'3510","reported_seq":2875,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937352+0000","last_change":"2024-05-09T12:29:47.042951+0000","last_active":"2024-05-09T12:29:54.937352+0000","last_peered":"2024-05-09T12:29:54.937352+0000","last_clean":"2024-05-09T12:29:54.937352+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:54.937352+0000","last_undegraded":"2024-05-09T12:29:54.937352+0000","last_fullsized":"2024-05-09T12:29:54.937352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3510","last_scrub_stamp":"2024-05-09T12:29:47.042817+0000","last_deep_scrub":"35'3510","last_deep_scrub_stamp":"2024-05-09T12:29:47.042817+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.042817+0000","objects_scrubbed":4,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:51.501486+0000","scrub_duration":8,"objects_trimmed":719,"snaptrim_duration":14.262935396,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"34'3393","reported_seq":2766,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933318+0000","last_change":"2024-05-09T12:29:41.259008+0000","last_active":"2024-05-09T12:29:54.933318+0000","last_peered":"2024-05-09T12:29:54.933318+0000","last_clean":"2024-05-09T12:29:54.933318+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:29:54.933318+0000","last_undegraded":"2024-05-09T12:29:54.933318+0000","last_fullsized":"2024-05-09T12:29:54.933318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3393,"log_dups_size":0,"ondisk_log_size":3393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":701,"snaptrim_duration":14.258178247,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'3272","reported_seq":2660,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935306+0000","last_change":"2024-05-09T12:29:53.493341+0000","last_active":"2024-05-09T12:29:54.935306+0000","last_peered":"2024-05-09T12:29:54.935306+0000","last_clean":"2024-05-09T12:29:54.935306+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:54.935306+0000","last_undegraded":"2024-05-09T12:29:54.935306+0000","last_fullsized":"2024-05-09T12:29:54.935306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3272","last_scrub_stamp":"2024-05-09T12:29:53.493215+0000","last_deep_scrub":"35'3272","last_deep_scrub_stamp":"2024-05-09T12:29:53.493215+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.493215+0000","objects_scrubbed":3,"log_size":3272,"log_dups_size":0,"ondisk_log_size":3272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:27.243066+0000","scrub_duration":7,"objects_trimmed":659,"snaptrim_duration":16.542539758,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'3565","reported_seq":2879,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.497596+0000","last_change":"2024-05-09T12:29:57.497624+0000","last_active":"2024-05-09T12:29:57.497596+0000","last_peered":"2024-05-09T12:29:57.497596+0000","last_clean":"2024-05-09T12:29:57.497596+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:57.497596+0000","last_undegraded":"2024-05-09T12:29:57.497596+0000","last_fullsized":"2024-05-09T12:29:57.497596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3565","last_scrub_stamp":"2024-05-09T12:29:57.497534+0000","last_deep_scrub":"36'3565","last_deep_scrub_stamp":"2024-05-09T12:29:57.497534+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.497534+0000","objects_scrubbed":1,"log_size":3565,"log_dups_size":0,"ondisk_log_size":3565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:51:28.219651+0000","scrub_duration":4,"objects_trimmed":762,"snaptrim_duration":17.862676060999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"35'2711","reported_seq":2221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936639+0000","last_change":"2024-05-09T12:29:52.467489+0000","last_active":"2024-05-09T12:29:54.936639+0000","last_peered":"2024-05-09T12:29:54.936639+0000","last_clean":"2024-05-09T12:29:54.936639+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:54.936639+0000","last_undegraded":"2024-05-09T12:29:54.936639+0000","last_fullsized":"2024-05-09T12:29:54.936639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2711","last_scrub_stamp":"2024-05-09T12:29:52.467285+0000","last_deep_scrub":"35'2711","last_deep_scrub_stamp":"2024-05-09T12:29:52.467285+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.467285+0000","objects_scrubbed":3,"log_size":2711,"log_dups_size":0,"ondisk_log_size":2711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:05.382012+0000","scrub_duration":6,"objects_trimmed":574,"snaptrim_duration":16.548693666999998,"stat_sum":{"num_bytes":21,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'3288","reported_seq":2703,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.512047+0000","last_change":"2024-05-09T12:29:53.561727+0000","last_active":"2024-05-09T12:29:55.512047+0000","last_peered":"2024-05-09T12:29:55.512047+0000","last_clean":"2024-05-09T12:29:55.512047+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:55.512047+0000","last_undegraded":"2024-05-09T12:29:55.512047+0000","last_fullsized":"2024-05-09T12:29:55.512047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3288","last_scrub_stamp":"2024-05-09T12:29:53.561589+0000","last_deep_scrub":"35'3288","last_deep_scrub_stamp":"2024-05-09T12:29:53.561589+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.561589+0000","objects_scrubbed":3,"log_size":3288,"log_dups_size":0,"ondisk_log_size":3288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:35:49.372839+0000","scrub_duration":6,"objects_trimmed":656,"snaptrim_duration":17.858281987000002,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3343","reported_seq":2722,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935755+0000","last_change":"2024-05-09T12:29:51.467114+0000","last_active":"2024-05-09T12:29:54.935755+0000","last_peered":"2024-05-09T12:29:54.935755+0000","last_clean":"2024-05-09T12:29:54.935755+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:54.935755+0000","last_undegraded":"2024-05-09T12:29:54.935755+0000","last_fullsized":"2024-05-09T12:29:54.935755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3343","last_scrub_stamp":"2024-05-09T12:29:51.466985+0000","last_deep_scrub":"35'3343","last_deep_scrub_stamp":"2024-05-09T12:29:51.466985+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.466985+0000","objects_scrubbed":2,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:25:53.982214+0000","scrub_duration":6,"objects_trimmed":684,"snaptrim_duration":16.547648935000002,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"34'3234","reported_seq":2669,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933781+0000","last_change":"2024-05-09T12:29:41.262296+0000","last_active":"2024-05-09T12:29:54.933781+0000","last_peered":"2024-05-09T12:29:54.933781+0000","last_clean":"2024-05-09T12:29:54.933781+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:29:54.933781+0000","last_undegraded":"2024-05-09T12:29:54.933781+0000","last_fullsized":"2024-05-09T12:29:54.933781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3234,"log_dups_size":0,"ondisk_log_size":3234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":645,"snaptrim_duration":14.263422158000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"35'3473","reported_seq":2796,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507820+0000","last_change":"2024-05-09T12:29:50.523522+0000","last_active":"2024-05-09T12:29:55.507820+0000","last_peered":"2024-05-09T12:29:55.507820+0000","last_clean":"2024-05-09T12:29:55.507820+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:55.507820+0000","last_undegraded":"2024-05-09T12:29:55.507820+0000","last_fullsized":"2024-05-09T12:29:55.507820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3473","last_scrub_stamp":"2024-05-09T12:29:50.523419+0000","last_deep_scrub":"35'3473","last_deep_scrub_stamp":"2024-05-09T12:29:50.523419+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.523419+0000","objects_scrubbed":3,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:55.116588+0000","scrub_duration":6,"objects_trimmed":483,"snaptrim_duration":17.856591616999999,"stat_sum":{"num_bytes":4116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"34'3162","reported_seq":2594,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934166+0000","last_change":"2024-05-09T12:29:42.310964+0000","last_active":"2024-05-09T12:29:54.934166+0000","last_peered":"2024-05-09T12:29:54.934166+0000","last_clean":"2024-05-09T12:29:54.934166+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:29:54.934166+0000","last_undegraded":"2024-05-09T12:29:54.934166+0000","last_fullsized":"2024-05-09T12:29:54.934166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3162,"log_dups_size":0,"ondisk_log_size":3162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":392,"snaptrim_duration":15.299419029999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"35'3413","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935473+0000","last_change":"2024-05-09T12:29:46.508697+0000","last_active":"2024-05-09T12:29:54.935473+0000","last_peered":"2024-05-09T12:29:54.935473+0000","last_clean":"2024-05-09T12:29:54.935473+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:54.935473+0000","last_undegraded":"2024-05-09T12:29:54.935473+0000","last_fullsized":"2024-05-09T12:29:54.935473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3413","last_scrub_stamp":"2024-05-09T12:29:46.508574+0000","last_deep_scrub":"35'3413","last_deep_scrub_stamp":"2024-05-09T12:29:46.508574+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.508574+0000","objects_scrubbed":1,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:21.411426+0000","scrub_duration":4,"objects_trimmed":680,"snaptrim_duration":16.544099152000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'2943","reported_seq":2404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935259+0000","last_change":"2024-05-09T12:29:54.552808+0000","last_active":"2024-05-09T12:29:54.935259+0000","last_peered":"2024-05-09T12:29:54.935259+0000","last_clean":"2024-05-09T12:29:54.935259+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:54.935259+0000","last_undegraded":"2024-05-09T12:29:54.935259+0000","last_fullsized":"2024-05-09T12:29:54.935259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2943","last_scrub_stamp":"2024-05-09T12:29:54.552724+0000","last_deep_scrub":"35'2943","last_deep_scrub_stamp":"2024-05-09T12:29:54.552724+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.552724+0000","objects_scrubbed":1,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:06:37.449247+0000","scrub_duration":4,"objects_trimmed":573,"snaptrim_duration":15.307284095,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"34'3480","reported_seq":2839,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.448710+0000","last_change":"2024-05-09T12:29:58.448733+0000","last_active":"2024-05-09T12:29:58.448710+0000","last_peered":"2024-05-09T12:29:58.448710+0000","last_clean":"2024-05-09T12:29:58.448710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:58.448710+0000","last_undegraded":"2024-05-09T12:29:58.448710+0000","last_fullsized":"2024-05-09T12:29:58.448710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3480","last_scrub_stamp":"2024-05-09T12:29:58.448630+0000","last_deep_scrub":"34'3480","last_deep_scrub_stamp":"2024-05-09T12:29:58.448630+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.448630+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:31:50.059374+0000","scrub_duration":2,"objects_trimmed":660,"snaptrim_duration":15.322415087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"34'3137","reported_seq":2532,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934860+0000","last_change":"2024-05-09T12:29:43.554389+0000","last_active":"2024-05-09T12:29:54.934860+0000","last_peered":"2024-05-09T12:29:54.934860+0000","last_clean":"2024-05-09T12:29:54.934860+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:29:54.934860+0000","last_undegraded":"2024-05-09T12:29:54.934860+0000","last_fullsized":"2024-05-09T12:29:54.934860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":658,"snaptrim_duration":16.55507819,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2976","reported_seq":2415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934657+0000","last_change":"2024-05-09T12:29:42.333597+0000","last_active":"2024-05-09T12:29:54.934657+0000","last_peered":"2024-05-09T12:29:54.934657+0000","last_clean":"2024-05-09T12:29:54.934657+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:29:54.934657+0000","last_undegraded":"2024-05-09T12:29:54.934657+0000","last_fullsized":"2024-05-09T12:29:54.934657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":2976,"log_dups_size":0,"ondisk_log_size":2976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":644,"snaptrim_duration":15.317983029000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"34'3395","reported_seq":2741,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508142+0000","last_change":"2024-05-09T12:29:44.861997+0000","last_active":"2024-05-09T12:29:55.508142+0000","last_peered":"2024-05-09T12:29:55.508142+0000","last_clean":"2024-05-09T12:29:55.508142+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:29:55.508142+0000","last_undegraded":"2024-05-09T12:29:55.508142+0000","last_fullsized":"2024-05-09T12:29:55.508142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3395,"log_dups_size":0,"ondisk_log_size":3395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":712,"snaptrim_duration":17.855217257,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'3045","reported_seq":2500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935389+0000","last_change":"2024-05-09T12:29:50.515090+0000","last_active":"2024-05-09T12:29:54.935389+0000","last_peered":"2024-05-09T12:29:54.935389+0000","last_clean":"2024-05-09T12:29:54.935389+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:54.935389+0000","last_undegraded":"2024-05-09T12:29:54.935389+0000","last_fullsized":"2024-05-09T12:29:54.935389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3045","last_scrub_stamp":"2024-05-09T12:29:50.514948+0000","last_deep_scrub":"35'3045","last_deep_scrub_stamp":"2024-05-09T12:29:50.514948+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.514948+0000","objects_scrubbed":2,"log_size":3045,"log_dups_size":0,"ondisk_log_size":3045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:55.108117+0000","scrub_duration":6,"objects_trimmed":593,"snaptrim_duration":16.548329506000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"36'3624","reported_seq":2911,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.482403+0000","last_change":"2024-05-09T12:29:57.482445+0000","last_active":"2024-05-09T12:29:57.482403+0000","last_peered":"2024-05-09T12:29:57.482403+0000","last_clean":"2024-05-09T12:29:57.482403+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:57.482403+0000","last_undegraded":"2024-05-09T12:29:57.482403+0000","last_fullsized":"2024-05-09T12:29:57.482403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3624","last_scrub_stamp":"2024-05-09T12:29:57.482305+0000","last_deep_scrub":"36'3624","last_deep_scrub_stamp":"2024-05-09T12:29:57.482305+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.482305+0000","objects_scrubbed":1,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:08.811184+0000","scrub_duration":5,"objects_trimmed":738,"snaptrim_duration":15.319004634000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"35'3691","reported_seq":3028,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933403+0000","last_change":"2024-05-09T12:29:48.091811+0000","last_active":"2024-05-09T12:29:54.933403+0000","last_peered":"2024-05-09T12:29:54.933403+0000","last_clean":"2024-05-09T12:29:54.933403+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:54.933403+0000","last_undegraded":"2024-05-09T12:29:54.933403+0000","last_fullsized":"2024-05-09T12:29:54.933403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3691","last_scrub_stamp":"2024-05-09T12:29:48.091684+0000","last_deep_scrub":"35'3691","last_deep_scrub_stamp":"2024-05-09T12:29:48.091684+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.091684+0000","objects_scrubbed":2,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:09.830112+0000","scrub_duration":7,"objects_trimmed":732,"snaptrim_duration":14.260704129000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"34'3345","reported_seq":2700,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935005+0000","last_change":"2024-05-09T12:29:42.341881+0000","last_active":"2024-05-09T12:29:54.935005+0000","last_peered":"2024-05-09T12:29:54.935005+0000","last_clean":"2024-05-09T12:29:54.935005+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:29:54.935005+0000","last_undegraded":"2024-05-09T12:29:54.935005+0000","last_fullsized":"2024-05-09T12:29:54.935005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":719,"snaptrim_duration":15.325952790000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"36'4098","reported_seq":4163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.531374+0000","last_change":"2024-05-09T12:29:56.531415+0000","last_active":"2024-05-09T12:29:56.531374+0000","last_peered":"2024-05-09T12:29:56.531374+0000","last_clean":"2024-05-09T12:29:56.531374+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:56.531374+0000","last_undegraded":"2024-05-09T12:29:56.531374+0000","last_fullsized":"2024-05-09T12:29:56.531374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4098","last_scrub_stamp":"2024-05-09T12:29:56.531282+0000","last_deep_scrub":"36'4098","last_deep_scrub_stamp":"2024-05-09T12:29:56.531282+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.531282+0000","objects_scrubbed":5,"log_size":4098,"log_dups_size":0,"ondisk_log_size":4098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:04.939321+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697586,"num_omap_keys":1384,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3264","reported_seq":2647,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935212+0000","last_change":"2024-05-09T12:29:43.685345+0000","last_active":"2024-05-09T12:29:54.935212+0000","last_peered":"2024-05-09T12:29:54.935212+0000","last_clean":"2024-05-09T12:29:54.935212+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:29:54.935212+0000","last_undegraded":"2024-05-09T12:29:54.935212+0000","last_fullsized":"2024-05-09T12:29:54.935212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3264,"log_dups_size":0,"ondisk_log_size":3264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":678,"snaptrim_duration":16.685636018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507839+0000","last_change":"2024-05-09T12:29:43.541977+0000","last_active":"2024-05-09T12:29:55.507839+0000","last_peered":"2024-05-09T12:29:55.507839+0000","last_clean":"2024-05-09T12:29:55.507839+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:55.507839+0000","last_undegraded":"2024-05-09T12:29:55.507839+0000","last_fullsized":"2024-05-09T12:29:55.507839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T12:29:43.541867+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T12:29:43.541867+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.541867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:04:42.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'3467","reported_seq":2875,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509050+0000","last_change":"2024-05-09T12:29:51.561347+0000","last_active":"2024-05-09T12:29:55.509050+0000","last_peered":"2024-05-09T12:29:55.509050+0000","last_clean":"2024-05-09T12:29:55.509050+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:55.509050+0000","last_undegraded":"2024-05-09T12:29:55.509050+0000","last_fullsized":"2024-05-09T12:29:55.509050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3467","last_scrub_stamp":"2024-05-09T12:29:51.561255+0000","last_deep_scrub":"35'3467","last_deep_scrub_stamp":"2024-05-09T12:29:51.561255+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.561255+0000","objects_scrubbed":2,"log_size":3467,"log_dups_size":0,"ondisk_log_size":3467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:25:54.076484+0000","scrub_duration":6,"objects_trimmed":661,"snaptrim_duration":17.866946301999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"36'624","reported_seq":689,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.528629+0000","last_change":"2024-05-09T12:29:58.528687+0000","last_active":"2024-05-09T12:29:58.528629+0000","last_peered":"2024-05-09T12:29:58.528629+0000","last_clean":"2024-05-09T12:29:58.528629+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:58.528629+0000","last_undegraded":"2024-05-09T12:29:58.528629+0000","last_fullsized":"2024-05-09T12:29:58.528629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'624","last_scrub_stamp":"2024-05-09T12:29:58.528521+0000","last_deep_scrub":"36'624","last_deep_scrub_stamp":"2024-05-09T12:29:58.528521+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.528521+0000","objects_scrubbed":1,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:15.880722+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"36'3281","reported_seq":2664,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.549285+0000","last_change":"2024-05-09T12:29:55.549307+0000","last_active":"2024-05-09T12:29:55.549285+0000","last_peered":"2024-05-09T12:29:55.549285+0000","last_clean":"2024-05-09T12:29:55.549285+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:55.549285+0000","last_undegraded":"2024-05-09T12:29:55.549285+0000","last_fullsized":"2024-05-09T12:29:55.549285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3281","last_scrub_stamp":"2024-05-09T12:29:55.549229+0000","last_deep_scrub":"36'3281","last_deep_scrub_stamp":"2024-05-09T12:29:55.549229+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.549229+0000","objects_scrubbed":1,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:14:17.270656+0000","scrub_duration":5,"objects_trimmed":688,"snaptrim_duration":17.863695927999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'57","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935830+0000","last_change":"2024-05-09T12:20:20.636835+0000","last_active":"2024-05-09T12:29:54.935830+0000","last_peered":"2024-05-09T12:29:54.935830+0000","last_clean":"2024-05-09T12:29:54.935830+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:29:54.935830+0000","last_undegraded":"2024-05-09T12:29:54.935830+0000","last_fullsized":"2024-05-09T12:29:54.935830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'1486","reported_seq":1551,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934158+0000","last_change":"2024-05-09T12:29:46.080811+0000","last_active":"2024-05-09T12:29:54.934158+0000","last_peered":"2024-05-09T12:29:54.934158+0000","last_clean":"2024-05-09T12:29:54.934158+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:54.934158+0000","last_undegraded":"2024-05-09T12:29:54.934158+0000","last_fullsized":"2024-05-09T12:29:54.934158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1486","last_scrub_stamp":"2024-05-09T12:29:46.080643+0000","last_deep_scrub":"35'1486","last_deep_scrub_stamp":"2024-05-09T12:29:46.080643+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.080643+0000","objects_scrubbed":2,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:56:35.795362+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"35'3245","reported_seq":2634,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935866+0000","last_change":"2024-05-09T12:29:48.480046+0000","last_active":"2024-05-09T12:29:54.935866+0000","last_peered":"2024-05-09T12:29:54.935866+0000","last_clean":"2024-05-09T12:29:54.935866+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:54.935866+0000","last_undegraded":"2024-05-09T12:29:54.935866+0000","last_fullsized":"2024-05-09T12:29:54.935866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3245","last_scrub_stamp":"2024-05-09T12:29:48.479869+0000","last_deep_scrub":"35'3245","last_deep_scrub_stamp":"2024-05-09T12:29:48.479869+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.479869+0000","objects_scrubbed":4,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:26.727632+0000","scrub_duration":9,"objects_trimmed":679,"snaptrim_duration":16.543114377999999,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"34'2806","reported_seq":2871,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935914+0000","last_change":"2024-05-09T12:29:43.157253+0000","last_active":"2024-05-09T12:29:54.935914+0000","last_peered":"2024-05-09T12:29:54.935914+0000","last_clean":"2024-05-09T12:29:54.935914+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:54.935914+0000","last_undegraded":"2024-05-09T12:29:54.935914+0000","last_fullsized":"2024-05-09T12:29:54.935914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2806","last_scrub_stamp":"2024-05-09T12:29:43.157147+0000","last_deep_scrub":"34'2806","last_deep_scrub_stamp":"2024-05-09T12:29:43.157147+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.157147+0000","objects_scrubbed":3,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:33.813160+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'3357","reported_seq":2729,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933648+0000","last_change":"2024-05-09T12:29:41.260428+0000","last_active":"2024-05-09T12:29:54.933648+0000","last_peered":"2024-05-09T12:29:54.933648+0000","last_clean":"2024-05-09T12:29:54.933648+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:29:54.933648+0000","last_undegraded":"2024-05-09T12:29:54.933648+0000","last_fullsized":"2024-05-09T12:29:54.933648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":669,"snaptrim_duration":14.259352838,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'6802","reported_seq":6867,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.569343+0000","last_change":"2024-05-09T12:29:55.569381+0000","last_active":"2024-05-09T12:29:55.569343+0000","last_peered":"2024-05-09T12:29:55.569343+0000","last_clean":"2024-05-09T12:29:55.569343+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:55.569343+0000","last_undegraded":"2024-05-09T12:29:55.569343+0000","last_fullsized":"2024-05-09T12:29:55.569343+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6802","last_scrub_stamp":"2024-05-09T12:29:55.569273+0000","last_deep_scrub":"36'6802","last_deep_scrub_stamp":"2024-05-09T12:29:55.569273+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.569273+0000","objects_scrubbed":8,"log_size":5602,"log_dups_size":0,"ondisk_log_size":5602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:14:17.290700+0000","scrub_duration":62,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"35'3261","reported_seq":2642,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937839+0000","last_change":"2024-05-09T12:29:54.153740+0000","last_active":"2024-05-09T12:29:54.937839+0000","last_peered":"2024-05-09T12:29:54.937839+0000","last_clean":"2024-05-09T12:29:54.937839+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:54.937839+0000","last_undegraded":"2024-05-09T12:29:54.937839+0000","last_fullsized":"2024-05-09T12:29:54.937839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3261","last_scrub_stamp":"2024-05-09T12:29:54.153600+0000","last_deep_scrub":"35'3261","last_deep_scrub_stamp":"2024-05-09T12:29:54.153600+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.153600+0000","objects_scrubbed":2,"log_size":3261,"log_dups_size":0,"ondisk_log_size":3261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:16.467698+0000","scrub_duration":6,"objects_trimmed":676,"snaptrim_duration":14.264500269999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'1921","reported_seq":1978,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936439+0000","last_change":"2024-05-09T12:20:20.634623+0000","last_active":"2024-05-09T12:29:54.936439+0000","last_peered":"2024-05-09T12:29:54.936439+0000","last_clean":"2024-05-09T12:29:54.936439+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:29:54.936439+0000","last_undegraded":"2024-05-09T12:29:54.936439+0000","last_fullsized":"2024-05-09T12:29:54.936439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"34'3061","reported_seq":2490,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508202+0000","last_change":"2024-05-09T12:29:44.866824+0000","last_active":"2024-05-09T12:29:55.508202+0000","last_peered":"2024-05-09T12:29:55.508202+0000","last_clean":"2024-05-09T12:29:55.508202+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:29:55.508202+0000","last_undegraded":"2024-05-09T12:29:55.508202+0000","last_fullsized":"2024-05-09T12:29:55.508202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3061,"log_dups_size":0,"ondisk_log_size":3061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":623,"snaptrim_duration":17.859866361000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"34'4540","reported_seq":4605,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934526+0000","last_change":"2024-05-09T12:29:44.564443+0000","last_active":"2024-05-09T12:29:54.934526+0000","last_peered":"2024-05-09T12:29:54.934526+0000","last_clean":"2024-05-09T12:29:54.934526+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:54.934526+0000","last_undegraded":"2024-05-09T12:29:54.934526+0000","last_fullsized":"2024-05-09T12:29:54.934526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4540","last_scrub_stamp":"2024-05-09T12:29:44.564290+0000","last_deep_scrub":"34'4540","last_deep_scrub_stamp":"2024-05-09T12:29:44.564290+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.564290+0000","objects_scrubbed":5,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:07.088134+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":840,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"34'3311","reported_seq":2650,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935990+0000","last_change":"2024-05-09T12:29:43.550926+0000","last_active":"2024-05-09T12:29:54.935990+0000","last_peered":"2024-05-09T12:29:54.935990+0000","last_clean":"2024-05-09T12:29:54.935990+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:29:54.935990+0000","last_undegraded":"2024-05-09T12:29:54.935990+0000","last_fullsized":"2024-05-09T12:29:54.935990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":704,"snaptrim_duration":16.551154678,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'3407","reported_seq":3472,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.530952+0000","last_change":"2024-05-09T12:29:57.530996+0000","last_active":"2024-05-09T12:29:57.530952+0000","last_peered":"2024-05-09T12:29:57.530952+0000","last_clean":"2024-05-09T12:29:57.530952+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:57.530952+0000","last_undegraded":"2024-05-09T12:29:57.530952+0000","last_fullsized":"2024-05-09T12:29:57.530952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3407","last_scrub_stamp":"2024-05-09T12:29:57.530810+0000","last_deep_scrub":"36'3407","last_deep_scrub_stamp":"2024-05-09T12:29:57.530810+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.530810+0000","objects_scrubbed":3,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:35.738376+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'3251","reported_seq":2638,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935485+0000","last_change":"2024-05-09T12:29:43.553529+0000","last_active":"2024-05-09T12:29:54.935485+0000","last_peered":"2024-05-09T12:29:54.935485+0000","last_clean":"2024-05-09T12:29:54.935485+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:29:54.935485+0000","last_undegraded":"2024-05-09T12:29:54.935485+0000","last_fullsized":"2024-05-09T12:29:54.935485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":697,"snaptrim_duration":16.554026155999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'1855","reported_seq":1912,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934284+0000","last_change":"2024-05-09T12:20:20.635183+0000","last_active":"2024-05-09T12:29:54.934284+0000","last_peered":"2024-05-09T12:29:54.934284+0000","last_clean":"2024-05-09T12:29:54.934284+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:29:54.934284+0000","last_undegraded":"2024-05-09T12:29:54.934284+0000","last_fullsized":"2024-05-09T12:29:54.934284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"36'3362","reported_seq":2705,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.102696+0000","last_change":"2024-05-09T12:29:57.102731+0000","last_active":"2024-05-09T12:29:57.102696+0000","last_peered":"2024-05-09T12:29:57.102696+0000","last_clean":"2024-05-09T12:29:57.102696+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:57.102696+0000","last_undegraded":"2024-05-09T12:29:57.102696+0000","last_fullsized":"2024-05-09T12:29:57.102696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3362","last_scrub_stamp":"2024-05-09T12:29:57.102614+0000","last_deep_scrub":"36'3362","last_deep_scrub_stamp":"2024-05-09T12:29:57.102614+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.102614+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:32.005466+0000","scrub_duration":8,"objects_trimmed":703,"snaptrim_duration":14.257684298999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"35'179","reported_seq":244,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934382+0000","last_change":"2024-05-09T12:29:48.462795+0000","last_active":"2024-05-09T12:29:54.934382+0000","last_peered":"2024-05-09T12:29:54.934382+0000","last_clean":"2024-05-09T12:29:54.934382+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:54.934382+0000","last_undegraded":"2024-05-09T12:29:54.934382+0000","last_fullsized":"2024-05-09T12:29:54.934382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'179","last_scrub_stamp":"2024-05-09T12:29:48.462659+0000","last_deep_scrub":"35'179","last_deep_scrub_stamp":"2024-05-09T12:29:48.462659+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.462659+0000","objects_scrubbed":1,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:37:46.686864+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'3235","reported_seq":2627,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.538628+0000","last_change":"2024-05-09T12:29:55.538656+0000","last_active":"2024-05-09T12:29:55.538628+0000","last_peered":"2024-05-09T12:29:55.538628+0000","last_clean":"2024-05-09T12:29:55.538628+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:55.538628+0000","last_undegraded":"2024-05-09T12:29:55.538628+0000","last_fullsized":"2024-05-09T12:29:55.538628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3235","last_scrub_stamp":"2024-05-09T12:29:55.538558+0000","last_deep_scrub":"36'3235","last_deep_scrub_stamp":"2024-05-09T12:29:55.538558+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.538558+0000","objects_scrubbed":3,"log_size":3235,"log_dups_size":0,"ondisk_log_size":3235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:03.124462+0000","scrub_duration":8,"objects_trimmed":690,"snaptrim_duration":15.317930050999999,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936062+0000","last_change":"2024-05-09T12:29:44.462498+0000","last_active":"2024-05-09T12:29:54.936062+0000","last_peered":"2024-05-09T12:29:54.936062+0000","last_clean":"2024-05-09T12:29:54.936062+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:54.936062+0000","last_undegraded":"2024-05-09T12:29:54.936062+0000","last_fullsized":"2024-05-09T12:29:54.936062+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:44.462394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:44.462394+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.462394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:18.128022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4950","reported_seq":5015,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935366+0000","last_change":"2024-05-09T12:29:42.606358+0000","last_active":"2024-05-09T12:29:54.935366+0000","last_peered":"2024-05-09T12:29:54.935366+0000","last_clean":"2024-05-09T12:29:54.935366+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:54.935366+0000","last_undegraded":"2024-05-09T12:29:54.935366+0000","last_fullsized":"2024-05-09T12:29:54.935366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4950","last_scrub_stamp":"2024-05-09T12:29:42.606121+0000","last_deep_scrub":"34'4950","last_deep_scrub_stamp":"2024-05-09T12:29:42.606121+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.606121+0000","objects_scrubbed":6,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:00.977528+0000","scrub_duration":105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'3218","reported_seq":2622,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935629+0000","last_change":"2024-05-09T12:29:43.555119+0000","last_active":"2024-05-09T12:29:54.935629+0000","last_peered":"2024-05-09T12:29:54.935629+0000","last_clean":"2024-05-09T12:29:54.935629+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:29:54.935629+0000","last_undegraded":"2024-05-09T12:29:54.935629+0000","last_fullsized":"2024-05-09T12:29:54.935629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":655,"snaptrim_duration":16.555241055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934428+0000","last_change":"2024-05-09T12:29:43.468348+0000","last_active":"2024-05-09T12:29:54.934428+0000","last_peered":"2024-05-09T12:29:54.934428+0000","last_clean":"2024-05-09T12:29:54.934428+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:54.934428+0000","last_undegraded":"2024-05-09T12:29:54.934428+0000","last_fullsized":"2024-05-09T12:29:54.934428+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:43.468219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:43.468219+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.468219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:31:35.078963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"35'1015","reported_seq":1080,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934358+0000","last_change":"2024-05-09T12:29:50.197716+0000","last_active":"2024-05-09T12:29:54.934358+0000","last_peered":"2024-05-09T12:29:54.934358+0000","last_clean":"2024-05-09T12:29:54.934358+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:54.934358+0000","last_undegraded":"2024-05-09T12:29:54.934358+0000","last_fullsized":"2024-05-09T12:29:54.934358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1015","last_scrub_stamp":"2024-05-09T12:29:50.197589+0000","last_deep_scrub":"35'1015","last_deep_scrub_stamp":"2024-05-09T12:29:50.197589+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.197589+0000","objects_scrubbed":3,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:06:33.094112+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'3181","reported_seq":2575,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935528+0000","last_change":"2024-05-09T12:29:46.469524+0000","last_active":"2024-05-09T12:29:54.935528+0000","last_peered":"2024-05-09T12:29:54.935528+0000","last_clean":"2024-05-09T12:29:54.935528+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:54.935528+0000","last_undegraded":"2024-05-09T12:29:54.935528+0000","last_fullsized":"2024-05-09T12:29:54.935528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3181","last_scrub_stamp":"2024-05-09T12:29:46.469384+0000","last_deep_scrub":"34'3181","last_deep_scrub_stamp":"2024-05-09T12:29:46.469384+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.469384+0000","objects_scrubbed":0,"log_size":3181,"log_dups_size":0,"ondisk_log_size":3181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:08.402105+0000","scrub_duration":2,"objects_trimmed":671,"snaptrim_duration":15.326463444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.938104+0000","last_change":"2024-05-09T12:29:42.121685+0000","last_active":"2024-05-09T12:29:54.938104+0000","last_peered":"2024-05-09T12:29:54.938104+0000","last_clean":"2024-05-09T12:29:54.938104+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:54.938104+0000","last_undegraded":"2024-05-09T12:29:54.938104+0000","last_fullsized":"2024-05-09T12:29:54.938104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:42.121580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:42.121580+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.121580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:04.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'4166","reported_seq":4231,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934433+0000","last_change":"2024-05-09T12:29:49.472781+0000","last_active":"2024-05-09T12:29:54.934433+0000","last_peered":"2024-05-09T12:29:54.934433+0000","last_clean":"2024-05-09T12:29:54.934433+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:54.934433+0000","last_undegraded":"2024-05-09T12:29:54.934433+0000","last_fullsized":"2024-05-09T12:29:54.934433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4166","last_scrub_stamp":"2024-05-09T12:29:49.472659+0000","last_deep_scrub":"35'4166","last_deep_scrub_stamp":"2024-05-09T12:29:49.472659+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.472659+0000","objects_scrubbed":2,"log_size":4166,"log_dups_size":0,"ondisk_log_size":4166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:59.638224+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":664814,"num_omap_keys":1318,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'3122","reported_seq":2544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935459+0000","last_change":"2024-05-09T12:29:47.428277+0000","last_active":"2024-05-09T12:29:54.935459+0000","last_peered":"2024-05-09T12:29:54.935459+0000","last_clean":"2024-05-09T12:29:54.935459+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:54.935459+0000","last_undegraded":"2024-05-09T12:29:54.935459+0000","last_fullsized":"2024-05-09T12:29:54.935459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3122","last_scrub_stamp":"2024-05-09T12:29:47.428180+0000","last_deep_scrub":"35'3122","last_deep_scrub_stamp":"2024-05-09T12:29:47.428180+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.428180+0000","objects_scrubbed":4,"log_size":3122,"log_dups_size":0,"ondisk_log_size":3122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:27.867052+0000","scrub_duration":9,"objects_trimmed":681,"snaptrim_duration":15.705157161000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934984+0000","last_change":"2024-05-09T12:29:41.485081+0000","last_active":"2024-05-09T12:29:54.934984+0000","last_peered":"2024-05-09T12:29:54.934984+0000","last_clean":"2024-05-09T12:29:54.934984+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:54.934984+0000","last_undegraded":"2024-05-09T12:29:54.934984+0000","last_fullsized":"2024-05-09T12:29:54.934984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.484958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.484958+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.484958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:14.472742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"35'74","reported_seq":163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936197+0000","last_change":"2024-05-09T12:29:45.510456+0000","last_active":"2024-05-09T12:29:54.936197+0000","last_peered":"2024-05-09T12:29:54.936197+0000","last_clean":"2024-05-09T12:29:54.936197+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:54.936197+0000","last_undegraded":"2024-05-09T12:29:54.936197+0000","last_fullsized":"2024-05-09T12:29:54.936197+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-05-09T12:29:45.510351+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-05-09T12:29:45.510351+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.510351+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:03:59.251487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2648","reported_seq":2840,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508088+0000","last_change":"2024-05-09T12:29:39.583785+0000","last_active":"2024-05-09T12:29:55.508088+0000","last_peered":"2024-05-09T12:29:55.508088+0000","last_clean":"2024-05-09T12:29:55.508088+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:55.508088+0000","last_undegraded":"2024-05-09T12:29:55.508088+0000","last_fullsized":"2024-05-09T12:29:55.508088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2648","last_scrub_stamp":"2024-05-09T12:29:39.583261+0000","last_deep_scrub":"34'2648","last_deep_scrub_stamp":"2024-05-09T12:29:39.583261+0000","last_clean_scrub_stamp":"2024-05-09T12:29:39.583261+0000","objects_scrubbed":5,"log_size":2648,"log_dups_size":0,"ondisk_log_size":2648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:30:43.939844+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"35'3227","reported_seq":2644,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508929+0000","last_change":"2024-05-09T12:29:48.542236+0000","last_active":"2024-05-09T12:29:55.508929+0000","last_peered":"2024-05-09T12:29:55.508929+0000","last_clean":"2024-05-09T12:29:55.508929+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:55.508929+0000","last_undegraded":"2024-05-09T12:29:55.508929+0000","last_fullsized":"2024-05-09T12:29:55.508929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3227","last_scrub_stamp":"2024-05-09T12:29:48.542135+0000","last_deep_scrub":"35'3227","last_deep_scrub_stamp":"2024-05-09T12:29:48.542135+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.542135+0000","objects_scrubbed":5,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:26.789898+0000","scrub_duration":10,"objects_trimmed":628,"snaptrim_duration":17.866315191999998,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"34'1375","reported_seq":1440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509080+0000","last_change":"2024-05-09T12:29:42.589441+0000","last_active":"2024-05-09T12:29:55.509080+0000","last_peered":"2024-05-09T12:29:55.509080+0000","last_clean":"2024-05-09T12:29:55.509080+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:55.509080+0000","last_undegraded":"2024-05-09T12:29:55.509080+0000","last_fullsized":"2024-05-09T12:29:55.509080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1375","last_scrub_stamp":"2024-05-09T12:29:42.589306+0000","last_deep_scrub":"34'1375","last_deep_scrub_stamp":"2024-05-09T12:29:42.589306+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.589306+0000","objects_scrubbed":4,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:11:47.850394+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11350522,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":14192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935473+0000","last_change":"2024-05-09T12:29:40.529917+0000","last_active":"2024-05-09T12:29:54.935473+0000","last_peered":"2024-05-09T12:29:54.935473+0000","last_clean":"2024-05-09T12:29:54.935473+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:54.935473+0000","last_undegraded":"2024-05-09T12:29:54.935473+0000","last_fullsized":"2024-05-09T12:29:54.935473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:40.529784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:40.529784+0000","last_clean_scrub_stamp":"2024-05-09T12:29:40.529784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:24:09.324077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'3065","reported_seq":2469,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.122225+0000","last_change":"2024-05-09T12:29:55.122260+0000","last_active":"2024-05-09T12:29:55.122225+0000","last_peered":"2024-05-09T12:29:55.122225+0000","last_clean":"2024-05-09T12:29:55.122225+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:55.122225+0000","last_undegraded":"2024-05-09T12:29:55.122225+0000","last_fullsized":"2024-05-09T12:29:55.122225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3065","last_scrub_stamp":"2024-05-09T12:29:55.122145+0000","last_deep_scrub":"36'3065","last_deep_scrub_stamp":"2024-05-09T12:29:55.122145+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.122145+0000","objects_scrubbed":4,"log_size":3065,"log_dups_size":0,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:28.787773+0000","scrub_duration":9,"objects_trimmed":661,"snaptrim_duration":14.258482733999999,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"35'31","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935598+0000","last_change":"2024-05-09T12:29:51.490083+0000","last_active":"2024-05-09T12:29:54.935598+0000","last_peered":"2024-05-09T12:29:54.935598+0000","last_clean":"2024-05-09T12:29:54.935598+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:54.935598+0000","last_undegraded":"2024-05-09T12:29:54.935598+0000","last_fullsized":"2024-05-09T12:29:54.935598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-05-09T12:29:51.489925+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-05-09T12:29:51.489925+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.489925+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:05.975229+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671934,"num_omap_keys":1333,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935270+0000","last_change":"2024-05-09T12:29:41.082063+0000","last_active":"2024-05-09T12:29:54.935270+0000","last_peered":"2024-05-09T12:29:54.935270+0000","last_clean":"2024-05-09T12:29:54.935270+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:54.935270+0000","last_undegraded":"2024-05-09T12:29:54.935270+0000","last_fullsized":"2024-05-09T12:29:54.935270+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.081937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.081937+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.081937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:12:52.067155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"35'3327","reported_seq":2657,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508171+0000","last_change":"2024-05-09T12:29:52.528459+0000","last_active":"2024-05-09T12:29:55.508171+0000","last_peered":"2024-05-09T12:29:55.508171+0000","last_clean":"2024-05-09T12:29:55.508171+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:55.508171+0000","last_undegraded":"2024-05-09T12:29:55.508171+0000","last_fullsized":"2024-05-09T12:29:55.508171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3327","last_scrub_stamp":"2024-05-09T12:29:52.528373+0000","last_deep_scrub":"35'3327","last_deep_scrub_stamp":"2024-05-09T12:29:52.528373+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.528373+0000","objects_scrubbed":1,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:05.443099+0000","scrub_duration":5,"objects_trimmed":534,"snaptrim_duration":17.853180898000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"32'27","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935367+0000","last_change":"2024-05-09T12:29:45.506656+0000","last_active":"2024-05-09T12:29:54.935367+0000","last_peered":"2024-05-09T12:29:54.935367+0000","last_clean":"2024-05-09T12:29:54.935367+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:54.935367+0000","last_undegraded":"2024-05-09T12:29:54.935367+0000","last_fullsized":"2024-05-09T12:29:54.935367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-05-09T12:29:45.506513+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-05-09T12:29:45.506513+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.506513+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:12:56.491731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936880+0000","last_change":"2024-05-09T12:29:42.423550+0000","last_active":"2024-05-09T12:29:54.936880+0000","last_peered":"2024-05-09T12:29:54.936880+0000","last_clean":"2024-05-09T12:29:54.936880+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:54.936880+0000","last_undegraded":"2024-05-09T12:29:54.936880+0000","last_fullsized":"2024-05-09T12:29:54.936880+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:42.423421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:42.423421+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.423421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:53.752300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"36'3469","reported_seq":2837,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.557507+0000","last_change":"2024-05-09T12:29:59.557553+0000","last_active":"2024-05-09T12:29:59.557507+0000","last_peered":"2024-05-09T12:29:59.557507+0000","last_clean":"2024-05-09T12:29:59.557507+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:59.557507+0000","last_undegraded":"2024-05-09T12:29:59.557507+0000","last_fullsized":"2024-05-09T12:29:59.557507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3469","last_scrub_stamp":"2024-05-09T12:29:59.557413+0000","last_deep_scrub":"36'3469","last_deep_scrub_stamp":"2024-05-09T12:29:59.557413+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.557413+0000","objects_scrubbed":2,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:30.650731+0000","scrub_duration":6,"objects_trimmed":729,"snaptrim_duration":17.860915869999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'2128","reported_seq":2193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934996+0000","last_change":"2024-05-09T12:29:52.127015+0000","last_active":"2024-05-09T12:29:54.934996+0000","last_peered":"2024-05-09T12:29:54.934996+0000","last_clean":"2024-05-09T12:29:54.934996+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:54.934996+0000","last_undegraded":"2024-05-09T12:29:54.934996+0000","last_fullsized":"2024-05-09T12:29:54.934996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2128","last_scrub_stamp":"2024-05-09T12:29:52.126878+0000","last_deep_scrub":"35'2128","last_deep_scrub_stamp":"2024-05-09T12:29:52.126878+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.126878+0000","objects_scrubbed":4,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:28.567184+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":539,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936898+0000","last_change":"2024-05-09T12:29:41.411436+0000","last_active":"2024-05-09T12:29:54.936898+0000","last_peered":"2024-05-09T12:29:54.936898+0000","last_clean":"2024-05-09T12:29:54.936898+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:54.936898+0000","last_undegraded":"2024-05-09T12:29:54.936898+0000","last_fullsized":"2024-05-09T12:29:54.936898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.411353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.411353+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.411353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:17.851658+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"35'3062","reported_seq":2504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934720+0000","last_change":"2024-05-09T12:29:52.466364+0000","last_active":"2024-05-09T12:29:54.934720+0000","last_peered":"2024-05-09T12:29:54.934720+0000","last_clean":"2024-05-09T12:29:54.934720+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:54.934720+0000","last_undegraded":"2024-05-09T12:29:54.934720+0000","last_fullsized":"2024-05-09T12:29:54.934720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3062","last_scrub_stamp":"2024-05-09T12:29:52.466235+0000","last_deep_scrub":"35'3062","last_deep_scrub_stamp":"2024-05-09T12:29:52.466235+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.466235+0000","objects_scrubbed":4,"log_size":3062,"log_dups_size":0,"ondisk_log_size":3062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:28.028525+0000","scrub_duration":10,"objects_trimmed":659,"snaptrim_duration":15.324016532,"stat_sum":{"num_bytes":8203,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'3269","reported_seq":2630,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.148815+0000","last_change":"2024-05-09T12:29:56.148850+0000","last_active":"2024-05-09T12:29:56.148815+0000","last_peered":"2024-05-09T12:29:56.148815+0000","last_clean":"2024-05-09T12:29:56.148815+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:56.148815+0000","last_undegraded":"2024-05-09T12:29:56.148815+0000","last_fullsized":"2024-05-09T12:29:56.148815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3269","last_scrub_stamp":"2024-05-09T12:29:56.148729+0000","last_deep_scrub":"36'3269","last_deep_scrub_stamp":"2024-05-09T12:29:56.148729+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.148729+0000","objects_scrubbed":2,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:04:09.889865+0000","scrub_duration":7,"objects_trimmed":718,"snaptrim_duration":14.265097418,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5456","reported_seq":5517,"reported_epoch":36,"state":"active+clean+scrubbing+deep","last_fresh":"2024-05-09T12:29:59.517762+0000","last_change":"2024-05-09T12:29:59.517532+0000","last_active":"2024-05-09T12:29:59.517762+0000","last_peered":"2024-05-09T12:29:59.517762+0000","last_clean":"2024-05-09T12:29:59.517762+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:59.517762+0000","last_undegraded":"2024-05-09T12:29:59.517762+0000","last_fullsized":"2024-05-09T12:29:59.517762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5456,"log_dups_size":0,"ondisk_log_size":5456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'3165","reported_seq":2581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.445592+0000","last_change":"2024-05-09T12:29:59.445623+0000","last_active":"2024-05-09T12:29:59.445592+0000","last_peered":"2024-05-09T12:29:59.445592+0000","last_clean":"2024-05-09T12:29:59.445592+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:59.445592+0000","last_undegraded":"2024-05-09T12:29:59.445592+0000","last_fullsized":"2024-05-09T12:29:59.445592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3165","last_scrub_stamp":"2024-05-09T12:29:59.445530+0000","last_deep_scrub":"36'3165","last_deep_scrub_stamp":"2024-05-09T12:29:59.445530+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.445530+0000","objects_scrubbed":5,"log_size":3165,"log_dups_size":0,"ondisk_log_size":3165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:33.111158+0000","scrub_duration":9,"objects_trimmed":663,"snaptrim_duration":15.323238147,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"35'3058","reported_seq":3122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934798+0000","last_change":"2024-05-09T12:29:45.121779+0000","last_active":"2024-05-09T12:29:54.934798+0000","last_peered":"2024-05-09T12:29:54.934798+0000","last_clean":"2024-05-09T12:29:54.934798+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:54.934798+0000","last_undegraded":"2024-05-09T12:29:54.934798+0000","last_fullsized":"2024-05-09T12:29:54.934798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3058","last_scrub_stamp":"2024-05-09T12:29:45.121683+0000","last_deep_scrub":"35'3058","last_deep_scrub_stamp":"2024-05-09T12:29:45.121683+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.121683+0000","objects_scrubbed":5,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:46:49.413761+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":711288,"num_omap_keys":1413,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"35'3362","reported_seq":3426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935808+0000","last_change":"2024-05-09T12:29:51.164491+0000","last_active":"2024-05-09T12:29:54.935808+0000","last_peered":"2024-05-09T12:29:54.935808+0000","last_clean":"2024-05-09T12:29:54.935808+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:54.935808+0000","last_undegraded":"2024-05-09T12:29:54.935808+0000","last_fullsized":"2024-05-09T12:29:54.935808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3362","last_scrub_stamp":"2024-05-09T12:29:51.164220+0000","last_deep_scrub":"35'3362","last_deep_scrub_stamp":"2024-05-09T12:29:51.164220+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.164220+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:58.750125+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673928,"num_omap_keys":1336,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"35'3409","reported_seq":2739,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507877+0000","last_change":"2024-05-09T12:29:46.539783+0000","last_active":"2024-05-09T12:29:55.507877+0000","last_peered":"2024-05-09T12:29:55.507877+0000","last_clean":"2024-05-09T12:29:55.507877+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:55.507877+0000","last_undegraded":"2024-05-09T12:29:55.507877+0000","last_fullsized":"2024-05-09T12:29:55.507877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3409","last_scrub_stamp":"2024-05-09T12:29:46.539693+0000","last_deep_scrub":"35'3409","last_deep_scrub_stamp":"2024-05-09T12:29:46.539693+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.539693+0000","objects_scrubbed":5,"log_size":3409,"log_dups_size":0,"ondisk_log_size":3409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:37:00.644214+0000","scrub_duration":10,"objects_trimmed":671,"snaptrim_duration":17.851274162999999,"stat_sum":{"num_bytes":121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"34'1017","reported_seq":1082,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509370+0000","last_change":"2024-05-09T12:29:44.595295+0000","last_active":"2024-05-09T12:29:55.509370+0000","last_peered":"2024-05-09T12:29:55.509370+0000","last_clean":"2024-05-09T12:29:55.509370+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:55.509370+0000","last_undegraded":"2024-05-09T12:29:55.509370+0000","last_fullsized":"2024-05-09T12:29:55.509370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1017","last_scrub_stamp":"2024-05-09T12:29:44.595151+0000","last_deep_scrub":"34'1017","last_deep_scrub_stamp":"2024-05-09T12:29:44.595151+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.595151+0000","objects_scrubbed":3,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:41.261796+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"34'3310","reported_seq":2680,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934270+0000","last_change":"2024-05-09T12:29:42.313711+0000","last_active":"2024-05-09T12:29:54.934270+0000","last_peered":"2024-05-09T12:29:54.934270+0000","last_clean":"2024-05-09T12:29:54.934270+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:29:54.934270+0000","last_undegraded":"2024-05-09T12:29:54.934270+0000","last_fullsized":"2024-05-09T12:29:54.934270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3310,"log_dups_size":0,"ondisk_log_size":3310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":438,"snaptrim_duration":15.292536912999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3039","reported_seq":2487,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936370+0000","last_change":"2024-05-09T12:29:43.551734+0000","last_active":"2024-05-09T12:29:54.936370+0000","last_peered":"2024-05-09T12:29:54.936370+0000","last_clean":"2024-05-09T12:29:54.936370+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:29:54.936370+0000","last_undegraded":"2024-05-09T12:29:54.936370+0000","last_fullsized":"2024-05-09T12:29:54.936370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3039,"log_dups_size":0,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":660,"snaptrim_duration":16.552079564,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2406","reported_seq":2470,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934281+0000","last_change":"2024-05-09T12:29:50.485872+0000","last_active":"2024-05-09T12:29:54.934281+0000","last_peered":"2024-05-09T12:29:54.934281+0000","last_clean":"2024-05-09T12:29:54.934281+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:54.934281+0000","last_undegraded":"2024-05-09T12:29:54.934281+0000","last_fullsized":"2024-05-09T12:29:54.934281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2406","last_scrub_stamp":"2024-05-09T12:29:50.485766+0000","last_deep_scrub":"35'2406","last_deep_scrub_stamp":"2024-05-09T12:29:50.485766+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.485766+0000","objects_scrubbed":6,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.505584+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707320,"num_omap_keys":1404,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"35'3124","reported_seq":2555,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508753+0000","last_change":"2024-05-09T12:29:47.540669+0000","last_active":"2024-05-09T12:29:55.508753+0000","last_peered":"2024-05-09T12:29:55.508753+0000","last_clean":"2024-05-09T12:29:55.508753+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:55.508753+0000","last_undegraded":"2024-05-09T12:29:55.508753+0000","last_fullsized":"2024-05-09T12:29:55.508753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3124","last_scrub_stamp":"2024-05-09T12:29:47.540510+0000","last_deep_scrub":"35'3124","last_deep_scrub_stamp":"2024-05-09T12:29:47.540510+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.540510+0000","objects_scrubbed":2,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:11:21.496216+0000","scrub_duration":7,"objects_trimmed":634,"snaptrim_duration":17.867235921999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'762","reported_seq":826,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934412+0000","last_change":"2024-05-09T12:29:43.567649+0000","last_active":"2024-05-09T12:29:54.934412+0000","last_peered":"2024-05-09T12:29:54.934412+0000","last_clean":"2024-05-09T12:29:54.934412+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:54.934412+0000","last_undegraded":"2024-05-09T12:29:54.934412+0000","last_fullsized":"2024-05-09T12:29:54.934412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'762","last_scrub_stamp":"2024-05-09T12:29:43.567500+0000","last_deep_scrub":"32'762","last_deep_scrub_stamp":"2024-05-09T12:29:43.567500+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.567500+0000","objects_scrubbed":1,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:39:41.242684+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"35'3162","reported_seq":2580,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.512035+0000","last_change":"2024-05-09T12:29:54.525513+0000","last_active":"2024-05-09T12:29:55.512035+0000","last_peered":"2024-05-09T12:29:55.512035+0000","last_clean":"2024-05-09T12:29:55.512035+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:55.512035+0000","last_undegraded":"2024-05-09T12:29:55.512035+0000","last_fullsized":"2024-05-09T12:29:55.512035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3162","last_scrub_stamp":"2024-05-09T12:29:54.525428+0000","last_deep_scrub":"35'3162","last_deep_scrub_stamp":"2024-05-09T12:29:54.525428+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.525428+0000","objects_scrubbed":1,"log_size":3162,"log_dups_size":0,"ondisk_log_size":3162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:35.861183+0000","scrub_duration":3,"objects_trimmed":660,"snaptrim_duration":17.859630848999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"35'6251","reported_seq":6315,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937997+0000","last_change":"2024-05-09T12:29:53.150170+0000","last_active":"2024-05-09T12:29:54.937997+0000","last_peered":"2024-05-09T12:29:54.937997+0000","last_clean":"2024-05-09T12:29:54.937997+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:54.937997+0000","last_undegraded":"2024-05-09T12:29:54.937997+0000","last_fullsized":"2024-05-09T12:29:54.937997+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6251","last_scrub_stamp":"2024-05-09T12:29:53.150039+0000","last_deep_scrub":"35'6251","last_deep_scrub_stamp":"2024-05-09T12:29:53.150039+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.150039+0000","objects_scrubbed":4,"log_size":5951,"log_dups_size":0,"ondisk_log_size":5951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:04.478918+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2575,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"36'3597","reported_seq":2894,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.512153+0000","last_change":"2024-05-09T12:29:56.512179+0000","last_active":"2024-05-09T12:29:56.512153+0000","last_peered":"2024-05-09T12:29:56.512153+0000","last_clean":"2024-05-09T12:29:56.512153+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:56.512153+0000","last_undegraded":"2024-05-09T12:29:56.512153+0000","last_fullsized":"2024-05-09T12:29:56.512153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3597","last_scrub_stamp":"2024-05-09T12:29:56.512060+0000","last_deep_scrub":"36'3597","last_deep_scrub_stamp":"2024-05-09T12:29:56.512060+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.512060+0000","objects_scrubbed":1,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:32.952366+0000","scrub_duration":5,"objects_trimmed":780,"snaptrim_duration":15.325386052000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"34'3298","reported_seq":3362,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508477+0000","last_change":"2024-05-09T12:29:41.532018+0000","last_active":"2024-05-09T12:29:55.508477+0000","last_peered":"2024-05-09T12:29:55.508477+0000","last_clean":"2024-05-09T12:29:55.508477+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:55.508477+0000","last_undegraded":"2024-05-09T12:29:55.508477+0000","last_fullsized":"2024-05-09T12:29:55.508477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3298","last_scrub_stamp":"2024-05-09T12:29:41.531882+0000","last_deep_scrub":"34'3298","last_deep_scrub_stamp":"2024-05-09T12:29:41.531882+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.531882+0000","objects_scrubbed":3,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:42.799792+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'3149","reported_seq":2532,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.064522+0000","last_change":"2024-05-09T12:29:58.064549+0000","last_active":"2024-05-09T12:29:58.064522+0000","last_peered":"2024-05-09T12:29:58.064522+0000","last_clean":"2024-05-09T12:29:58.064522+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:58.064522+0000","last_undegraded":"2024-05-09T12:29:58.064522+0000","last_fullsized":"2024-05-09T12:29:58.064522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3149","last_scrub_stamp":"2024-05-09T12:29:58.064405+0000","last_deep_scrub":"34'3149","last_deep_scrub_stamp":"2024-05-09T12:29:58.064405+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.064405+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:10.393110+0000","scrub_duration":2,"objects_trimmed":717,"snaptrim_duration":15.179340623,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'627","reported_seq":691,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936210+0000","last_change":"2024-05-09T12:29:44.120988+0000","last_active":"2024-05-09T12:29:54.936210+0000","last_peered":"2024-05-09T12:29:54.936210+0000","last_clean":"2024-05-09T12:29:54.936210+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:54.936210+0000","last_undegraded":"2024-05-09T12:29:54.936210+0000","last_fullsized":"2024-05-09T12:29:54.936210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'627","last_scrub_stamp":"2024-05-09T12:29:44.120861+0000","last_deep_scrub":"34'627","last_deep_scrub_stamp":"2024-05-09T12:29:44.120861+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.120861+0000","objects_scrubbed":1,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:37:42.345066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'3199","reported_seq":2573,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937565+0000","last_change":"2024-05-09T12:29:41.262930+0000","last_active":"2024-05-09T12:29:54.937565+0000","last_peered":"2024-05-09T12:29:54.937565+0000","last_clean":"2024-05-09T12:29:54.937565+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:29:54.937565+0000","last_undegraded":"2024-05-09T12:29:54.937565+0000","last_fullsized":"2024-05-09T12:29:54.937565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:20.607024+0000","last_clean_scrub_stamp":"2024-05-09T12:20:20.607024+0000","objects_scrubbed":0,"log_size":3199,"log_dups_size":0,"ondisk_log_size":3199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":679,"snaptrim_duration":14.263989603000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'8181","reported_seq":8237,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935433+0000","last_change":"2024-05-09T12:20:20.634277+0000","last_active":"2024-05-09T12:29:54.935433+0000","last_peered":"2024-05-09T12:29:54.935433+0000","last_clean":"2024-05-09T12:29:54.935433+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:29:54.935433+0000","last_undegraded":"2024-05-09T12:29:54.935433+0000","last_fullsized":"2024-05-09T12:29:54.935433+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:20:19.598551+0000","last_clean_scrub_stamp":"2024-05-09T12:20:19.598551+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'3075","reported_seq":2500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508251+0000","last_change":"2024-05-09T12:29:49.495099+0000","last_active":"2024-05-09T12:29:55.508251+0000","last_peered":"2024-05-09T12:29:55.508251+0000","last_clean":"2024-05-09T12:29:55.508251+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:55.508251+0000","last_undegraded":"2024-05-09T12:29:55.508251+0000","last_fullsized":"2024-05-09T12:29:55.508251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3075","last_scrub_stamp":"2024-05-09T12:29:49.494974+0000","last_deep_scrub":"35'3075","last_deep_scrub_stamp":"2024-05-09T12:29:49.494974+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.494974+0000","objects_scrubbed":1,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:30.762555+0000","scrub_duration":3,"objects_trimmed":629,"snaptrim_duration":17.854617736000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'5556","reported_seq":5621,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508914+0000","last_change":"2024-05-09T12:29:40.610218+0000","last_active":"2024-05-09T12:29:55.508914+0000","last_peered":"2024-05-09T12:29:55.508914+0000","last_clean":"2024-05-09T12:29:55.508914+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:55.508914+0000","last_undegraded":"2024-05-09T12:29:55.508914+0000","last_fullsized":"2024-05-09T12:29:55.508914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5556","last_scrub_stamp":"2024-05-09T12:29:40.609902+0000","last_deep_scrub":"34'5556","last_deep_scrub_stamp":"2024-05-09T12:29:40.609902+0000","last_clean_scrub_stamp":"2024-05-09T12:29:40.609902+0000","objects_scrubbed":4,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:16:19.019232+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'3783","reported_seq":3033,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.096478+0000","last_change":"2024-05-09T12:29:59.096515+0000","last_active":"2024-05-09T12:29:59.096478+0000","last_peered":"2024-05-09T12:29:59.096478+0000","last_clean":"2024-05-09T12:29:59.096478+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:59.096478+0000","last_undegraded":"2024-05-09T12:29:59.096478+0000","last_fullsized":"2024-05-09T12:29:59.096478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3783","last_scrub_stamp":"2024-05-09T12:29:59.096393+0000","last_deep_scrub":"36'3783","last_deep_scrub_stamp":"2024-05-09T12:29:59.096393+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.096393+0000","objects_scrubbed":4,"log_size":3783,"log_dups_size":0,"ondisk_log_size":3783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:37.344156+0000","scrub_duration":8,"objects_trimmed":799,"snaptrim_duration":14.263458647,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2441","reported_seq":2506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509235+0000","last_change":"2024-05-09T12:29:45.567556+0000","last_active":"2024-05-09T12:29:55.509235+0000","last_peered":"2024-05-09T12:29:55.509235+0000","last_clean":"2024-05-09T12:29:55.509235+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:55.509235+0000","last_undegraded":"2024-05-09T12:29:55.509235+0000","last_fullsized":"2024-05-09T12:29:55.509235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2441","last_scrub_stamp":"2024-05-09T12:29:45.567415+0000","last_deep_scrub":"35'2441","last_deep_scrub_stamp":"2024-05-09T12:29:45.567415+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.567415+0000","objects_scrubbed":5,"log_size":2441,"log_dups_size":0,"ondisk_log_size":2441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:29.814234+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62238,"num_omap_keys":124,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127343,"num_objects":147,"num_object_clones":20,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":12,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":254492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208845,"ondisk_log_size":208845,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287136858,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87026,"num_write_kb":575472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4194062,"num_omap_keys":8322,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574341120,"data_stored":574273716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82434,"ondisk_log_size":82434,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705784,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":764744,"kb_used_data":115776,"kb_used_omap":1,"kb_used_meta":648958,"kb_avail":93607096,"statfs":{"total":96636764160,"available":95853666304,"internally_reserved":0,"allocated":118554624,"data_stored":118255999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":664533447},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705784,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969020,"kb_used_data":171508,"kb_used_omap":1,"kb_used_meta":797502,"kb_avail":93402820,"statfs":{"total":96636764160,"available":95644487680,"internally_reserved":0,"allocated":175624192,"data_stored":175337621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":816642501},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705786,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":588676,"kb_used_data":106364,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93783164,"statfs":{"total":96636764160,"available":96033959936,"internally_reserved":0,"allocated":108916736,"data_stored":108617205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":493877701},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705786,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":827520,"kb_used_data":170296,"kb_used_omap":1,"kb_used_meta":657214,"kb_avail":93544320,"statfs":{"total":96636764160,"available":95789383680,"internally_reserved":0,"allocated":174383104,"data_stored":174080851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":672987589},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173907968,"data_stored":173889922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107823104,"data_stored":107819514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":45246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":61640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":69703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":77903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:30:01.932 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.932 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.932 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.932 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.932 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.933 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.934 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.935 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.935 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.935 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.935 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.935 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.936 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T12:20:20.607024+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=20, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.936 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T12:20:19.598551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=12, tm_min=29, tm_sec=37, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T12:30:01.936 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T12:30:21.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T12:30:22.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.037+0000 7f14fa12b640 1 Processor -- start 2024-05-09T12:30:22.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.037+0000 7f14fa12b640 1 -- start start 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14fa12b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14fa12b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14fa12b640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f40718a0 con 0x7f14f41375a0 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14fa12b640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f14f4072490 con 0x7f14f4140140 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14fa12b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14f4072960 con 0x7f14f413d810 2024-05-09T12:30:22.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14f2ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14f3fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14f3fff640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.135:57802/0 (socket says 172.21.15.135:57802) 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14f3fff640 1 -- 172.21.15.135:0/3600463106 learned_addr learned my addr 172.21.15.135:0/3600463106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.038+0000 7f14f2ffd640 1 --2- 172.21.15.135:0/3600463106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:36444/0 (socket says 172.21.15.135:36444) 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f2ffd640 1 -- 172.21.15.135:0/3600463106 >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 msgr2=0x7f14f4142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f2ffd640 1 --2- 172.21.15.135:0/3600463106 >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f2ffd640 1 -- 172.21.15.135:0/3600463106 >> v1:172.21.15.160:6789/0 conn(0x7f14f41375a0 legacy=0x7f14f4137980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f2ffd640 1 -- 172.21.15.135:0/3600463106 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f4072c20 con 0x7f14f413d810 2024-05-09T12:30:22.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f3fff640 1 --2- 172.21.15.135:0/3600463106 >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:30:22.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.039+0000 7f14f2ffd640 1 --2- 172.21.15.135:0/3600463106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14e40097a0 tx=0x7f14e402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc6ac0721759070f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14f27fc640 1 -- 172.21.15.135:0/3600463106 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4038070 con 0x7f14f413d810 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14f27fc640 1 -- 172.21.15.135:0/3600463106 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e4031700 con 0x7f14f413d810 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14f27fc640 1 -- 172.21.15.135:0/3600463106 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4031ad0 con 0x7f14f413d810 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 -- 172.21.15.135:0/3600463106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 msgr2=0x7f14f413fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 --2- 172.21.15.135:0/3600463106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14e40097a0 tx=0x7f14e402b7a0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 -- 172.21.15.135:0/3600463106 shutdown_connections 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 --2- 172.21.15.135:0/3600463106 >> v2:172.21.15.160:3300/0 conn(0x7f14f4140140 0x7f14f4142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 --2- 172.21.15.135:0/3600463106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f413d810 0x7f14f413fc00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 -- 172.21.15.135:0/3600463106 >> 172.21.15.135:0/3600463106 conn(0x7f14f40ab940 msgr2=0x7f14f40abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 -- 172.21.15.135:0/3600463106 shutdown_connections 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.040+0000 7f14fa12b640 1 -- 172.21.15.135:0/3600463106 wait complete. 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.041+0000 7f14fa12b640 1 Processor -- start 2024-05-09T12:30:22.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.041+0000 7f14fa12b640 1 -- start start 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f41375a0 0x7f14f409ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f413d810 0x7f14f409bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4074970 con 0x7f14f4140140 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4073ae0 con 0x7f14f413d810 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14fa12b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14f409deb0 con 0x7f14f41375a0 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44120/0 (socket says 172.21.15.135:44120) 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 -- 172.21.15.135:0/4185019417 learned_addr learned my addr 172.21.15.135:0/4185019417 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f2ffd640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f413d810 0x7f14f409bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f37fe640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f41375a0 0x7f14f409ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 -- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f41375a0 msgr2=0x7f14f409ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f41375a0 0x7f14f409ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 -- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f413d810 msgr2=0x7f14f409bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f413d810 0x7f14f409bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.042+0000 7f14f3fff640 1 -- 172.21.15.135:0/4185019417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f4139dc0 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14f3fff640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009e70 tx=0x7f14ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00cbe0 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec00cd80 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f4139260 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec003bb0 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.043+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f409d5a0 con 0x7f14f4140140 2024-05-09T12:30:22.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.044+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f40ab6b0 con 0x7f14f4140140 2024-05-09T12:30:22.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.045+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14ec005d10 con 0x7f14f4140140 2024-05-09T12:30:22.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.045+0000 7f14dbfff640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 0x7f14e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.046+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7f14ec097170 con 0x7f14f4140140 2024-05-09T12:30:22.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.046+0000 7f14f37fe640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 0x7f14e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.046+0000 7f14f37fe640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 0x7f14e0078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000f60 tx=0x7f14e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.050+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f14ec022020 con 0x7f14f4140140 2024-05-09T12:30:22.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.230+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 --> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14f40a90d0 con 0x7f14e00762d0 2024-05-09T12:30:22.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.237+0000 7f14dbfff640 1 -- 172.21.15.135:0/4185019417 <== mgr.4107 v2:172.21.15.135:6816/185233510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+272612 (secure 0 0 0) 0x7f14e80014e0 con 0x7f14e00762d0 2024-05-09T12:30:22.240 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:30:22.242 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 msgr2=0x7f14e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 0x7f14e0078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000f60 tx=0x7f14e8009040 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 msgr2=0x7f14f409c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009e70 tx=0x7f14ec00c490 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 shutdown_connections 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f14e00762d0 0x7f14e0078790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14f4140140 0x7f14f409c4b0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f413d810 0x7f14f409bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 --2- 172.21.15.135:0/4185019417 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14f41375a0 0x7f14f409ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 >> 172.21.15.135:0/4185019417 conn(0x7f14f40ab940 msgr2=0x7f14f4135790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 shutdown_connections 2024-05-09T12:30:22.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.240+0000 7f14fa12b640 1 -- 172.21.15.135:0/4185019417 wait complete. 2024-05-09T12:30:22.252 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-05-09T12:30:21.493432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":287854569,"num_objects":266,"num_object_clones":20,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":12,"num_read":255,"num_read_kb":3256,"num_write":164635,"num_write_kb":617697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5655308,"num_omap_keys":11211,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291417,"ondisk_log_size":291417,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3149960,"kb_used_data":563944,"kb_used_omap":6,"kb_used_meta":2585977,"kb_avail":374337400,"statfs":{"total":386547056640,"available":383321497600,"internally_reserved":0,"allocated":577478656,"data_stored":576291676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":2648041238},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002024"},"pg_stats":[{"pgid":"4.3f","version":"34'3050","reported_seq":2480,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:00.574694+0000","last_change":"2024-05-09T12:30:00.574715+0000","last_active":"2024-05-09T12:30:00.574694+0000","last_peered":"2024-05-09T12:30:00.574694+0000","last_clean":"2024-05-09T12:30:00.574694+0000","last_became_active":"2024-05-09T12:20:21.638746+0000","last_became_peered":"2024-05-09T12:20:21.638746+0000","last_unstale":"2024-05-09T12:30:00.574694+0000","last_undegraded":"2024-05-09T12:30:00.574694+0000","last_fullsized":"2024-05-09T12:30:00.574694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3050","last_scrub_stamp":"2024-05-09T12:30:00.574623+0000","last_deep_scrub":"34'3050","last_deep_scrub_stamp":"2024-05-09T12:30:00.574623+0000","last_clean_scrub_stamp":"2024-05-09T12:30:00.574623+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:05.623646+0000","scrub_duration":2,"objects_trimmed":622,"snaptrim_duration":17.864578351999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"34'3197","reported_seq":2607,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:01.105119+0000","last_change":"2024-05-09T12:30:01.105145+0000","last_active":"2024-05-09T12:30:01.105119+0000","last_peered":"2024-05-09T12:30:01.105119+0000","last_clean":"2024-05-09T12:30:01.105119+0000","last_became_active":"2024-05-09T12:20:21.640237+0000","last_became_peered":"2024-05-09T12:20:21.640237+0000","last_unstale":"2024-05-09T12:30:01.105119+0000","last_undegraded":"2024-05-09T12:30:01.105119+0000","last_fullsized":"2024-05-09T12:30:01.105119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3197","last_scrub_stamp":"2024-05-09T12:30:01.105031+0000","last_deep_scrub":"34'3197","last_deep_scrub_stamp":"2024-05-09T12:30:01.105031+0000","last_clean_scrub_stamp":"2024-05-09T12:30:01.105031+0000","objects_scrubbed":0,"log_size":3197,"log_dups_size":0,"ondisk_log_size":3197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:05.698200+0000","scrub_duration":2,"objects_trimmed":448,"snaptrim_duration":14.256971752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'3285","reported_seq":2713,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934614+0000","last_change":"2024-05-09T12:29:54.498844+0000","last_active":"2024-05-09T12:29:54.934614+0000","last_peered":"2024-05-09T12:29:54.934614+0000","last_clean":"2024-05-09T12:29:54.934614+0000","last_became_active":"2024-05-09T12:20:21.639061+0000","last_became_peered":"2024-05-09T12:20:21.639061+0000","last_unstale":"2024-05-09T12:29:54.934614+0000","last_undegraded":"2024-05-09T12:29:54.934614+0000","last_fullsized":"2024-05-09T12:29:54.934614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3285","last_scrub_stamp":"2024-05-09T12:29:54.498724+0000","last_deep_scrub":"35'3285","last_deep_scrub_stamp":"2024-05-09T12:29:54.498724+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.498724+0000","objects_scrubbed":2,"log_size":3285,"log_dups_size":0,"ondisk_log_size":3285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:35.834479+0000","scrub_duration":6,"objects_trimmed":663,"snaptrim_duration":16.553678722000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'3474","reported_seq":2790,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:03.168727+0000","last_change":"2024-05-09T12:30:03.168763+0000","last_active":"2024-05-09T12:30:03.168727+0000","last_peered":"2024-05-09T12:30:03.168727+0000","last_clean":"2024-05-09T12:30:03.168727+0000","last_became_active":"2024-05-09T12:20:21.641210+0000","last_became_peered":"2024-05-09T12:20:21.641210+0000","last_unstale":"2024-05-09T12:30:03.168727+0000","last_undegraded":"2024-05-09T12:30:03.168727+0000","last_fullsized":"2024-05-09T12:30:03.168727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3474","last_scrub_stamp":"2024-05-09T12:30:03.168626+0000","last_deep_scrub":"36'3474","last_deep_scrub_stamp":"2024-05-09T12:30:03.168626+0000","last_clean_scrub_stamp":"2024-05-09T12:30:03.168626+0000","objects_scrubbed":2,"log_size":3474,"log_dups_size":0,"ondisk_log_size":3474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:16.083353+0000","scrub_duration":6,"objects_trimmed":735,"snaptrim_duration":14.259408158999999,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1295,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'3385","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.547563+0000","last_change":"2024-05-09T12:29:58.547589+0000","last_active":"2024-05-09T12:29:58.547563+0000","last_peered":"2024-05-09T12:29:58.547563+0000","last_clean":"2024-05-09T12:29:58.547563+0000","last_became_active":"2024-05-09T12:20:21.639530+0000","last_became_peered":"2024-05-09T12:20:21.639530+0000","last_unstale":"2024-05-09T12:29:58.547563+0000","last_undegraded":"2024-05-09T12:29:58.547563+0000","last_fullsized":"2024-05-09T12:29:58.547563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3385","last_scrub_stamp":"2024-05-09T12:29:58.547504+0000","last_deep_scrub":"36'3385","last_deep_scrub_stamp":"2024-05-09T12:29:58.547504+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.547504+0000","objects_scrubbed":2,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:44:10.420698+0000","scrub_duration":5,"objects_trimmed":690,"snaptrim_duration":17.859802576,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1251,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"35'3341","reported_seq":2742,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935135+0000","last_change":"2024-05-09T12:29:47.517358+0000","last_active":"2024-05-09T12:29:54.935135+0000","last_peered":"2024-05-09T12:29:54.935135+0000","last_clean":"2024-05-09T12:29:54.935135+0000","last_became_active":"2024-05-09T12:20:21.635153+0000","last_became_peered":"2024-05-09T12:20:21.635153+0000","last_unstale":"2024-05-09T12:29:54.935135+0000","last_undegraded":"2024-05-09T12:29:54.935135+0000","last_fullsized":"2024-05-09T12:29:54.935135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3341","last_scrub_stamp":"2024-05-09T12:29:47.517225+0000","last_deep_scrub":"35'3341","last_deep_scrub_stamp":"2024-05-09T12:29:47.517225+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.517225+0000","objects_scrubbed":4,"log_size":3341,"log_dups_size":0,"ondisk_log_size":3341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:59.845930+0000","scrub_duration":9,"objects_trimmed":688,"snaptrim_duration":16.547100930999999,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"36'3251","reported_seq":2666,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:06.521410+0000","last_change":"2024-05-09T12:30:06.521457+0000","last_active":"2024-05-09T12:30:06.521410+0000","last_peered":"2024-05-09T12:30:06.521410+0000","last_clean":"2024-05-09T12:30:06.521410+0000","last_became_active":"2024-05-09T12:20:21.641679+0000","last_became_peered":"2024-05-09T12:20:21.641679+0000","last_unstale":"2024-05-09T12:30:06.521410+0000","last_undegraded":"2024-05-09T12:30:06.521410+0000","last_fullsized":"2024-05-09T12:30:06.521410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3251","last_scrub_stamp":"2024-05-09T12:30:06.521322+0000","last_deep_scrub":"36'3251","last_deep_scrub_stamp":"2024-05-09T12:30:06.521322+0000","last_clean_scrub_stamp":"2024-05-09T12:30:06.521322+0000","objects_scrubbed":3,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:43.661892+0000","scrub_duration":8,"objects_trimmed":448,"snaptrim_duration":16.540123852000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"35'3148","reported_seq":2561,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934878+0000","last_change":"2024-05-09T12:29:49.489533+0000","last_active":"2024-05-09T12:29:54.934878+0000","last_peered":"2024-05-09T12:29:54.934878+0000","last_clean":"2024-05-09T12:29:54.934878+0000","last_became_active":"2024-05-09T12:20:21.635856+0000","last_became_peered":"2024-05-09T12:20:21.635856+0000","last_unstale":"2024-05-09T12:29:54.934878+0000","last_undegraded":"2024-05-09T12:29:54.934878+0000","last_fullsized":"2024-05-09T12:29:54.934878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3148","last_scrub_stamp":"2024-05-09T12:29:49.489397+0000","last_deep_scrub":"35'3148","last_deep_scrub_stamp":"2024-05-09T12:29:49.489397+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.489397+0000","objects_scrubbed":3,"log_size":3148,"log_dups_size":0,"ondisk_log_size":3148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:30.756978+0000","scrub_duration":8,"objects_trimmed":466,"snaptrim_duration":16.541869661,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'3367","reported_seq":2753,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.511950+0000","last_change":"2024-05-09T12:29:56.511950+0000","last_active":"2024-05-09T12:29:56.511950+0000","last_peered":"2024-05-09T12:29:56.511950+0000","last_clean":"2024-05-09T12:29:56.511950+0000","last_became_active":"2024-05-09T12:20:21.639165+0000","last_became_peered":"2024-05-09T12:20:21.639165+0000","last_unstale":"2024-05-09T12:29:56.511950+0000","last_undegraded":"2024-05-09T12:29:56.511950+0000","last_fullsized":"2024-05-09T12:29:56.511950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3367","last_scrub_stamp":"2024-05-09T12:29:56.511821+0000","last_deep_scrub":"36'3367","last_deep_scrub_stamp":"2024-05-09T12:29:56.511821+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.511821+0000","objects_scrubbed":4,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:49:17.197397+0000","scrub_duration":8,"objects_trimmed":674,"snaptrim_duration":17.862469918999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"36'2900","reported_seq":2375,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:07.482216+0000","last_change":"2024-05-09T12:30:07.482249+0000","last_active":"2024-05-09T12:30:07.482216+0000","last_peered":"2024-05-09T12:30:07.482216+0000","last_clean":"2024-05-09T12:30:07.482216+0000","last_became_active":"2024-05-09T12:20:21.641341+0000","last_became_peered":"2024-05-09T12:20:21.641341+0000","last_unstale":"2024-05-09T12:30:07.482216+0000","last_undegraded":"2024-05-09T12:30:07.482216+0000","last_fullsized":"2024-05-09T12:30:07.482216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2900","last_scrub_stamp":"2024-05-09T12:30:07.482098+0000","last_deep_scrub":"36'2900","last_deep_scrub_stamp":"2024-05-09T12:30:07.482098+0000","last_clean_scrub_stamp":"2024-05-09T12:30:07.482098+0000","objects_scrubbed":2,"log_size":2900,"log_dups_size":0,"ondisk_log_size":2900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:43.778429+0000","scrub_duration":5,"objects_trimmed":613,"snaptrim_duration":16.547575371000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1077,"num_write_kb":577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"35'2981","reported_seq":2435,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934565+0000","last_change":"2024-05-09T12:29:49.140218+0000","last_active":"2024-05-09T12:29:54.934565+0000","last_peered":"2024-05-09T12:29:54.934565+0000","last_clean":"2024-05-09T12:29:54.934565+0000","last_became_active":"2024-05-09T12:20:21.634090+0000","last_became_peered":"2024-05-09T12:20:21.634090+0000","last_unstale":"2024-05-09T12:29:54.934565+0000","last_undegraded":"2024-05-09T12:29:54.934565+0000","last_fullsized":"2024-05-09T12:29:54.934565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2981","last_scrub_stamp":"2024-05-09T12:29:49.140089+0000","last_deep_scrub":"35'2981","last_deep_scrub_stamp":"2024-05-09T12:29:49.140089+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.140089+0000","objects_scrubbed":4,"log_size":2981,"log_dups_size":0,"ondisk_log_size":2981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.048807+0000","scrub_duration":8,"objects_trimmed":419,"snaptrim_duration":14.254656912,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"35'3185","reported_seq":2565,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934863+0000","last_change":"2024-05-09T12:29:53.514723+0000","last_active":"2024-05-09T12:29:54.934863+0000","last_peered":"2024-05-09T12:29:54.934863+0000","last_clean":"2024-05-09T12:29:54.934863+0000","last_became_active":"2024-05-09T12:20:21.630234+0000","last_became_peered":"2024-05-09T12:20:21.630234+0000","last_unstale":"2024-05-09T12:29:54.934863+0000","last_undegraded":"2024-05-09T12:29:54.934863+0000","last_fullsized":"2024-05-09T12:29:54.934863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3185","last_scrub_stamp":"2024-05-09T12:29:53.514590+0000","last_deep_scrub":"35'3185","last_deep_scrub_stamp":"2024-05-09T12:29:53.514590+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.514590+0000","objects_scrubbed":6,"log_size":3185,"log_dups_size":0,"ondisk_log_size":3185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:03.423309+0000","scrub_duration":9,"objects_trimmed":714,"snaptrim_duration":15.32309437,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'3244","reported_seq":2677,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:03.635991+0000","last_change":"2024-05-09T12:30:03.635991+0000","last_active":"2024-05-09T12:30:03.635991+0000","last_peered":"2024-05-09T12:30:03.635991+0000","last_clean":"2024-05-09T12:30:03.635991+0000","last_became_active":"2024-05-09T12:20:21.642029+0000","last_became_peered":"2024-05-09T12:20:21.642029+0000","last_unstale":"2024-05-09T12:30:03.635991+0000","last_undegraded":"2024-05-09T12:30:03.635991+0000","last_fullsized":"2024-05-09T12:30:03.635991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3244","last_scrub_stamp":"2024-05-09T12:30:03.635896+0000","last_deep_scrub":"36'3244","last_deep_scrub_stamp":"2024-05-09T12:30:03.635896+0000","last_clean_scrub_stamp":"2024-05-09T12:30:03.635896+0000","objects_scrubbed":3,"log_size":3244,"log_dups_size":0,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:48:31.389485+0000","scrub_duration":6,"objects_trimmed":621,"snaptrim_duration":17.854655624999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"35'3510","reported_seq":2875,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937352+0000","last_change":"2024-05-09T12:29:47.042951+0000","last_active":"2024-05-09T12:29:54.937352+0000","last_peered":"2024-05-09T12:29:54.937352+0000","last_clean":"2024-05-09T12:29:54.937352+0000","last_became_active":"2024-05-09T12:20:21.635631+0000","last_became_peered":"2024-05-09T12:20:21.635631+0000","last_unstale":"2024-05-09T12:29:54.937352+0000","last_undegraded":"2024-05-09T12:29:54.937352+0000","last_fullsized":"2024-05-09T12:29:54.937352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3510","last_scrub_stamp":"2024-05-09T12:29:47.042817+0000","last_deep_scrub":"35'3510","last_deep_scrub_stamp":"2024-05-09T12:29:47.042817+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.042817+0000","objects_scrubbed":4,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:51.501486+0000","scrub_duration":8,"objects_trimmed":719,"snaptrim_duration":14.262935396,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1269,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"36'3396","reported_seq":2777,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:02.153235+0000","last_change":"2024-05-09T12:30:02.153289+0000","last_active":"2024-05-09T12:30:02.153235+0000","last_peered":"2024-05-09T12:30:02.153235+0000","last_clean":"2024-05-09T12:30:02.153235+0000","last_became_active":"2024-05-09T12:20:21.640240+0000","last_became_peered":"2024-05-09T12:20:21.640240+0000","last_unstale":"2024-05-09T12:30:02.153235+0000","last_undegraded":"2024-05-09T12:30:02.153235+0000","last_fullsized":"2024-05-09T12:30:02.153235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3396","last_scrub_stamp":"2024-05-09T12:30:02.153132+0000","last_deep_scrub":"36'3396","last_deep_scrub_stamp":"2024-05-09T12:30:02.153132+0000","last_clean_scrub_stamp":"2024-05-09T12:30:02.153132+0000","objects_scrubbed":3,"log_size":3396,"log_dups_size":0,"ondisk_log_size":3396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:26:04.668360+0000","scrub_duration":6,"objects_trimmed":701,"snaptrim_duration":14.258178247,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'3272","reported_seq":2660,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935306+0000","last_change":"2024-05-09T12:29:53.493341+0000","last_active":"2024-05-09T12:29:54.935306+0000","last_peered":"2024-05-09T12:29:54.935306+0000","last_clean":"2024-05-09T12:29:54.935306+0000","last_became_active":"2024-05-09T12:20:21.634640+0000","last_became_peered":"2024-05-09T12:20:21.634640+0000","last_unstale":"2024-05-09T12:29:54.935306+0000","last_undegraded":"2024-05-09T12:29:54.935306+0000","last_fullsized":"2024-05-09T12:29:54.935306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3272","last_scrub_stamp":"2024-05-09T12:29:53.493215+0000","last_deep_scrub":"35'3272","last_deep_scrub_stamp":"2024-05-09T12:29:53.493215+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.493215+0000","objects_scrubbed":3,"log_size":3272,"log_dups_size":0,"ondisk_log_size":3272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:27.243066+0000","scrub_duration":7,"objects_trimmed":659,"snaptrim_duration":16.542539758,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'3565","reported_seq":2879,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.497596+0000","last_change":"2024-05-09T12:29:57.497624+0000","last_active":"2024-05-09T12:29:57.497596+0000","last_peered":"2024-05-09T12:29:57.497596+0000","last_clean":"2024-05-09T12:29:57.497596+0000","last_became_active":"2024-05-09T12:20:21.639577+0000","last_became_peered":"2024-05-09T12:20:21.639577+0000","last_unstale":"2024-05-09T12:29:57.497596+0000","last_undegraded":"2024-05-09T12:29:57.497596+0000","last_fullsized":"2024-05-09T12:29:57.497596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3565","last_scrub_stamp":"2024-05-09T12:29:57.497534+0000","last_deep_scrub":"36'3565","last_deep_scrub_stamp":"2024-05-09T12:29:57.497534+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.497534+0000","objects_scrubbed":1,"log_size":3565,"log_dups_size":0,"ondisk_log_size":3565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:51:28.219651+0000","scrub_duration":4,"objects_trimmed":762,"snaptrim_duration":17.862676060999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1331,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"35'2711","reported_seq":2221,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936639+0000","last_change":"2024-05-09T12:29:52.467489+0000","last_active":"2024-05-09T12:29:54.936639+0000","last_peered":"2024-05-09T12:29:54.936639+0000","last_clean":"2024-05-09T12:29:54.936639+0000","last_became_active":"2024-05-09T12:20:21.638086+0000","last_became_peered":"2024-05-09T12:20:21.638086+0000","last_unstale":"2024-05-09T12:29:54.936639+0000","last_undegraded":"2024-05-09T12:29:54.936639+0000","last_fullsized":"2024-05-09T12:29:54.936639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2711","last_scrub_stamp":"2024-05-09T12:29:52.467285+0000","last_deep_scrub":"35'2711","last_deep_scrub_stamp":"2024-05-09T12:29:52.467285+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.467285+0000","objects_scrubbed":3,"log_size":2711,"log_dups_size":0,"ondisk_log_size":2711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:05.382012+0000","scrub_duration":6,"objects_trimmed":574,"snaptrim_duration":16.548693666999998,"stat_sum":{"num_bytes":21,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1046,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"35'3288","reported_seq":2703,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.512047+0000","last_change":"2024-05-09T12:29:53.561727+0000","last_active":"2024-05-09T12:29:55.512047+0000","last_peered":"2024-05-09T12:29:55.512047+0000","last_clean":"2024-05-09T12:29:55.512047+0000","last_became_active":"2024-05-09T12:20:21.635848+0000","last_became_peered":"2024-05-09T12:20:21.635848+0000","last_unstale":"2024-05-09T12:29:55.512047+0000","last_undegraded":"2024-05-09T12:29:55.512047+0000","last_fullsized":"2024-05-09T12:29:55.512047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3288","last_scrub_stamp":"2024-05-09T12:29:53.561589+0000","last_deep_scrub":"35'3288","last_deep_scrub_stamp":"2024-05-09T12:29:53.561589+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.561589+0000","objects_scrubbed":3,"log_size":3288,"log_dups_size":0,"ondisk_log_size":3288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:35:49.372839+0000","scrub_duration":6,"objects_trimmed":656,"snaptrim_duration":17.858281987000002,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1222,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"35'3343","reported_seq":2722,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935755+0000","last_change":"2024-05-09T12:29:51.467114+0000","last_active":"2024-05-09T12:29:54.935755+0000","last_peered":"2024-05-09T12:29:54.935755+0000","last_clean":"2024-05-09T12:29:54.935755+0000","last_became_active":"2024-05-09T12:20:21.636776+0000","last_became_peered":"2024-05-09T12:20:21.636776+0000","last_unstale":"2024-05-09T12:29:54.935755+0000","last_undegraded":"2024-05-09T12:29:54.935755+0000","last_fullsized":"2024-05-09T12:29:54.935755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3343","last_scrub_stamp":"2024-05-09T12:29:51.466985+0000","last_deep_scrub":"35'3343","last_deep_scrub_stamp":"2024-05-09T12:29:51.466985+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.466985+0000","objects_scrubbed":2,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:25:53.982214+0000","scrub_duration":6,"objects_trimmed":684,"snaptrim_duration":16.547648935000002,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"36'3237","reported_seq":2680,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:00.087870+0000","last_change":"2024-05-09T12:30:00.087904+0000","last_active":"2024-05-09T12:30:00.087870+0000","last_peered":"2024-05-09T12:30:00.087870+0000","last_clean":"2024-05-09T12:30:00.087870+0000","last_became_active":"2024-05-09T12:20:21.636141+0000","last_became_peered":"2024-05-09T12:20:21.636141+0000","last_unstale":"2024-05-09T12:30:00.087870+0000","last_undegraded":"2024-05-09T12:30:00.087870+0000","last_fullsized":"2024-05-09T12:30:00.087870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3237","last_scrub_stamp":"2024-05-09T12:30:00.087784+0000","last_deep_scrub":"36'3237","last_deep_scrub_stamp":"2024-05-09T12:30:00.087784+0000","last_clean_scrub_stamp":"2024-05-09T12:30:00.087784+0000","objects_scrubbed":3,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:41.355365+0000","scrub_duration":6,"objects_trimmed":645,"snaptrim_duration":14.263422158000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"35'3473","reported_seq":2796,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507820+0000","last_change":"2024-05-09T12:29:50.523522+0000","last_active":"2024-05-09T12:29:55.507820+0000","last_peered":"2024-05-09T12:29:55.507820+0000","last_clean":"2024-05-09T12:29:55.507820+0000","last_became_active":"2024-05-09T12:20:21.633919+0000","last_became_peered":"2024-05-09T12:20:21.633919+0000","last_unstale":"2024-05-09T12:29:55.507820+0000","last_undegraded":"2024-05-09T12:29:55.507820+0000","last_fullsized":"2024-05-09T12:29:55.507820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3473","last_scrub_stamp":"2024-05-09T12:29:50.523419+0000","last_deep_scrub":"35'3473","last_deep_scrub_stamp":"2024-05-09T12:29:50.523419+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.523419+0000","objects_scrubbed":3,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:55.116588+0000","scrub_duration":6,"objects_trimmed":483,"snaptrim_duration":17.856591616999999,"stat_sum":{"num_bytes":4116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1306,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"36'3165","reported_seq":2605,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:01.445312+0000","last_change":"2024-05-09T12:30:01.445343+0000","last_active":"2024-05-09T12:30:01.445312+0000","last_peered":"2024-05-09T12:30:01.445312+0000","last_clean":"2024-05-09T12:30:01.445312+0000","last_became_active":"2024-05-09T12:20:21.637338+0000","last_became_peered":"2024-05-09T12:20:21.637338+0000","last_unstale":"2024-05-09T12:30:01.445312+0000","last_undegraded":"2024-05-09T12:30:01.445312+0000","last_fullsized":"2024-05-09T12:30:01.445312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3165","last_scrub_stamp":"2024-05-09T12:30:01.445250+0000","last_deep_scrub":"36'3165","last_deep_scrub_stamp":"2024-05-09T12:30:01.445250+0000","last_clean_scrub_stamp":"2024-05-09T12:30:01.445250+0000","objects_scrubbed":3,"log_size":3165,"log_dups_size":0,"ondisk_log_size":3165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:36.348102+0000","scrub_duration":7,"objects_trimmed":392,"snaptrim_duration":15.299419029999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"35'3413","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935473+0000","last_change":"2024-05-09T12:29:46.508697+0000","last_active":"2024-05-09T12:29:54.935473+0000","last_peered":"2024-05-09T12:29:54.935473+0000","last_clean":"2024-05-09T12:29:54.935473+0000","last_became_active":"2024-05-09T12:20:21.637111+0000","last_became_peered":"2024-05-09T12:20:21.637111+0000","last_unstale":"2024-05-09T12:29:54.935473+0000","last_undegraded":"2024-05-09T12:29:54.935473+0000","last_fullsized":"2024-05-09T12:29:54.935473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3413","last_scrub_stamp":"2024-05-09T12:29:46.508574+0000","last_deep_scrub":"35'3413","last_deep_scrub_stamp":"2024-05-09T12:29:46.508574+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.508574+0000","objects_scrubbed":1,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:21.411426+0000","scrub_duration":4,"objects_trimmed":680,"snaptrim_duration":16.544099152000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'2943","reported_seq":2404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935259+0000","last_change":"2024-05-09T12:29:54.552808+0000","last_active":"2024-05-09T12:29:54.935259+0000","last_peered":"2024-05-09T12:29:54.935259+0000","last_clean":"2024-05-09T12:29:54.935259+0000","last_became_active":"2024-05-09T12:20:21.630882+0000","last_became_peered":"2024-05-09T12:20:21.630882+0000","last_unstale":"2024-05-09T12:29:54.935259+0000","last_undegraded":"2024-05-09T12:29:54.935259+0000","last_fullsized":"2024-05-09T12:29:54.935259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2943","last_scrub_stamp":"2024-05-09T12:29:54.552724+0000","last_deep_scrub":"35'2943","last_deep_scrub_stamp":"2024-05-09T12:29:54.552724+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.552724+0000","objects_scrubbed":1,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:06:37.449247+0000","scrub_duration":4,"objects_trimmed":573,"snaptrim_duration":15.307284095,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"34'3480","reported_seq":2839,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.448710+0000","last_change":"2024-05-09T12:29:58.448733+0000","last_active":"2024-05-09T12:29:58.448710+0000","last_peered":"2024-05-09T12:29:58.448710+0000","last_clean":"2024-05-09T12:29:58.448710+0000","last_became_active":"2024-05-09T12:20:21.634595+0000","last_became_peered":"2024-05-09T12:20:21.634595+0000","last_unstale":"2024-05-09T12:29:58.448710+0000","last_undegraded":"2024-05-09T12:29:58.448710+0000","last_fullsized":"2024-05-09T12:29:58.448710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3480","last_scrub_stamp":"2024-05-09T12:29:58.448630+0000","last_deep_scrub":"34'3480","last_deep_scrub_stamp":"2024-05-09T12:29:58.448630+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.448630+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:31:50.059374+0000","scrub_duration":2,"objects_trimmed":660,"snaptrim_duration":15.322415087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"34'3137","reported_seq":2540,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:04.489895+0000","last_change":"2024-05-09T12:30:04.489923+0000","last_active":"2024-05-09T12:30:04.489895+0000","last_peered":"2024-05-09T12:30:04.489895+0000","last_clean":"2024-05-09T12:30:04.489895+0000","last_became_active":"2024-05-09T12:20:21.639358+0000","last_became_peered":"2024-05-09T12:20:21.639358+0000","last_unstale":"2024-05-09T12:30:04.489895+0000","last_undegraded":"2024-05-09T12:30:04.489895+0000","last_fullsized":"2024-05-09T12:30:04.489895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3137","last_scrub_stamp":"2024-05-09T12:30:04.489784+0000","last_deep_scrub":"34'3137","last_deep_scrub_stamp":"2024-05-09T12:30:04.489784+0000","last_clean_scrub_stamp":"2024-05-09T12:30:04.489784+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:49.455750+0000","scrub_duration":2,"objects_trimmed":658,"snaptrim_duration":16.55507819,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'2977","reported_seq":2424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:02.411351+0000","last_change":"2024-05-09T12:30:02.411397+0000","last_active":"2024-05-09T12:30:02.411351+0000","last_peered":"2024-05-09T12:30:02.411351+0000","last_clean":"2024-05-09T12:30:02.411351+0000","last_became_active":"2024-05-09T12:20:21.642199+0000","last_became_peered":"2024-05-09T12:20:21.642199+0000","last_unstale":"2024-05-09T12:30:02.411351+0000","last_undegraded":"2024-05-09T12:30:02.411351+0000","last_fullsized":"2024-05-09T12:30:02.411351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2977","last_scrub_stamp":"2024-05-09T12:30:02.411276+0000","last_deep_scrub":"36'2977","last_deep_scrub_stamp":"2024-05-09T12:30:02.411276+0000","last_clean_scrub_stamp":"2024-05-09T12:30:02.411276+0000","objects_scrubbed":1,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:14.739982+0000","scrub_duration":5,"objects_trimmed":644,"snaptrim_duration":15.317983029000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"36'3400","reported_seq":2754,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:02.617354+0000","last_change":"2024-05-09T12:30:02.617386+0000","last_active":"2024-05-09T12:30:02.617354+0000","last_peered":"2024-05-09T12:30:02.617354+0000","last_clean":"2024-05-09T12:30:02.617354+0000","last_became_active":"2024-05-09T12:20:21.640155+0000","last_became_peered":"2024-05-09T12:20:21.640155+0000","last_unstale":"2024-05-09T12:30:02.617354+0000","last_undegraded":"2024-05-09T12:30:02.617354+0000","last_fullsized":"2024-05-09T12:30:02.617354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3400","last_scrub_stamp":"2024-05-09T12:30:02.617285+0000","last_deep_scrub":"36'3400","last_deep_scrub_stamp":"2024-05-09T12:30:02.617285+0000","last_clean_scrub_stamp":"2024-05-09T12:30:02.617285+0000","objects_scrubbed":5,"log_size":3400,"log_dups_size":0,"ondisk_log_size":3400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:25:42.990082+0000","scrub_duration":9,"objects_trimmed":712,"snaptrim_duration":17.855217257,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":4,"num_read_kb":3,"num_write":1239,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'3045","reported_seq":2500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935389+0000","last_change":"2024-05-09T12:29:50.515090+0000","last_active":"2024-05-09T12:29:54.935389+0000","last_peered":"2024-05-09T12:29:54.935389+0000","last_clean":"2024-05-09T12:29:54.935389+0000","last_became_active":"2024-05-09T12:20:21.638048+0000","last_became_peered":"2024-05-09T12:20:21.638048+0000","last_unstale":"2024-05-09T12:29:54.935389+0000","last_undegraded":"2024-05-09T12:29:54.935389+0000","last_fullsized":"2024-05-09T12:29:54.935389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3045","last_scrub_stamp":"2024-05-09T12:29:50.514948+0000","last_deep_scrub":"35'3045","last_deep_scrub_stamp":"2024-05-09T12:29:50.514948+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.514948+0000","objects_scrubbed":2,"log_size":3045,"log_dups_size":0,"ondisk_log_size":3045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:55.108117+0000","scrub_duration":6,"objects_trimmed":593,"snaptrim_duration":16.548329506000002,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1117,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"36'3624","reported_seq":2911,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.482403+0000","last_change":"2024-05-09T12:29:57.482445+0000","last_active":"2024-05-09T12:29:57.482403+0000","last_peered":"2024-05-09T12:29:57.482403+0000","last_clean":"2024-05-09T12:29:57.482403+0000","last_became_active":"2024-05-09T12:20:21.634499+0000","last_became_peered":"2024-05-09T12:20:21.634499+0000","last_unstale":"2024-05-09T12:29:57.482403+0000","last_undegraded":"2024-05-09T12:29:57.482403+0000","last_fullsized":"2024-05-09T12:29:57.482403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3624","last_scrub_stamp":"2024-05-09T12:29:57.482305+0000","last_deep_scrub":"36'3624","last_deep_scrub_stamp":"2024-05-09T12:29:57.482305+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.482305+0000","objects_scrubbed":1,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:08.811184+0000","scrub_duration":5,"objects_trimmed":738,"snaptrim_duration":15.319004634000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"35'3691","reported_seq":3028,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.933403+0000","last_change":"2024-05-09T12:29:48.091811+0000","last_active":"2024-05-09T12:29:54.933403+0000","last_peered":"2024-05-09T12:29:54.933403+0000","last_clean":"2024-05-09T12:29:54.933403+0000","last_became_active":"2024-05-09T12:20:21.635495+0000","last_became_peered":"2024-05-09T12:20:21.635495+0000","last_unstale":"2024-05-09T12:29:54.933403+0000","last_undegraded":"2024-05-09T12:29:54.933403+0000","last_fullsized":"2024-05-09T12:29:54.933403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3691","last_scrub_stamp":"2024-05-09T12:29:48.091684+0000","last_deep_scrub":"35'3691","last_deep_scrub_stamp":"2024-05-09T12:29:48.091684+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.091684+0000","objects_scrubbed":2,"log_size":3691,"log_dups_size":0,"ondisk_log_size":3691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:09.830112+0000","scrub_duration":7,"objects_trimmed":732,"snaptrim_duration":14.260704129000001,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1304,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"36'3347","reported_seq":2710,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:03.426425+0000","last_change":"2024-05-09T12:30:03.426453+0000","last_active":"2024-05-09T12:30:03.426425+0000","last_peered":"2024-05-09T12:30:03.426425+0000","last_clean":"2024-05-09T12:30:03.426425+0000","last_became_active":"2024-05-09T12:20:21.642172+0000","last_became_peered":"2024-05-09T12:20:21.642172+0000","last_unstale":"2024-05-09T12:30:03.426425+0000","last_undegraded":"2024-05-09T12:30:03.426425+0000","last_fullsized":"2024-05-09T12:30:03.426425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3347","last_scrub_stamp":"2024-05-09T12:30:03.426364+0000","last_deep_scrub":"36'3347","last_deep_scrub_stamp":"2024-05-09T12:30:03.426364+0000","last_clean_scrub_stamp":"2024-05-09T12:30:03.426364+0000","objects_scrubbed":2,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:41.674127+0000","scrub_duration":6,"objects_trimmed":719,"snaptrim_duration":15.325952790000001,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"36'4098","reported_seq":4163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.531374+0000","last_change":"2024-05-09T12:29:56.531415+0000","last_active":"2024-05-09T12:29:56.531374+0000","last_peered":"2024-05-09T12:29:56.531374+0000","last_clean":"2024-05-09T12:29:56.531374+0000","last_became_active":"2024-05-09T12:20:20.628545+0000","last_became_peered":"2024-05-09T12:20:20.628545+0000","last_unstale":"2024-05-09T12:29:56.531374+0000","last_undegraded":"2024-05-09T12:29:56.531374+0000","last_fullsized":"2024-05-09T12:29:56.531374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4098","last_scrub_stamp":"2024-05-09T12:29:56.531282+0000","last_deep_scrub":"36'4098","last_deep_scrub_stamp":"2024-05-09T12:29:56.531282+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.531282+0000","objects_scrubbed":5,"log_size":4098,"log_dups_size":0,"ondisk_log_size":4098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:04.939321+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4091,"num_write_kb":18525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697586,"num_omap_keys":1384,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"36'3266","reported_seq":2658,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:11.456881+0000","last_change":"2024-05-09T12:30:11.456914+0000","last_active":"2024-05-09T12:30:11.456881+0000","last_peered":"2024-05-09T12:30:11.456881+0000","last_clean":"2024-05-09T12:30:11.456881+0000","last_became_active":"2024-05-09T12:20:21.643265+0000","last_became_peered":"2024-05-09T12:20:21.643265+0000","last_unstale":"2024-05-09T12:30:11.456881+0000","last_undegraded":"2024-05-09T12:30:11.456881+0000","last_fullsized":"2024-05-09T12:30:11.456881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3266","last_scrub_stamp":"2024-05-09T12:30:11.456793+0000","last_deep_scrub":"36'3266","last_deep_scrub_stamp":"2024-05-09T12:30:11.456793+0000","last_clean_scrub_stamp":"2024-05-09T12:30:11.456793+0000","objects_scrubbed":2,"log_size":3266,"log_dups_size":0,"ondisk_log_size":3266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:27:01.185761+0000","scrub_duration":6,"objects_trimmed":678,"snaptrim_duration":16.685636018,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'4","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507839+0000","last_change":"2024-05-09T12:29:43.541977+0000","last_active":"2024-05-09T12:29:55.507839+0000","last_peered":"2024-05-09T12:29:55.507839+0000","last_clean":"2024-05-09T12:29:55.507839+0000","last_became_active":"2024-05-09T12:20:20.631313+0000","last_became_peered":"2024-05-09T12:20:20.631313+0000","last_unstale":"2024-05-09T12:29:55.507839+0000","last_undegraded":"2024-05-09T12:29:55.507839+0000","last_fullsized":"2024-05-09T12:29:55.507839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T12:29:43.541867+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T12:29:43.541867+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.541867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:04:42.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'3467","reported_seq":2876,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509104+0000","last_change":"2024-05-09T12:29:51.561347+0000","last_active":"2024-05-09T12:29:55.509104+0000","last_peered":"2024-05-09T12:29:55.509104+0000","last_clean":"2024-05-09T12:29:55.509104+0000","last_became_active":"2024-05-09T12:20:21.636147+0000","last_became_peered":"2024-05-09T12:20:21.636147+0000","last_unstale":"2024-05-09T12:29:55.509104+0000","last_undegraded":"2024-05-09T12:29:55.509104+0000","last_fullsized":"2024-05-09T12:29:55.509104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3467","last_scrub_stamp":"2024-05-09T12:29:51.561255+0000","last_deep_scrub":"35'3467","last_deep_scrub_stamp":"2024-05-09T12:29:51.561255+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.561255+0000","objects_scrubbed":2,"log_size":3467,"log_dups_size":0,"ondisk_log_size":3467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:25:54.076484+0000","scrub_duration":6,"objects_trimmed":661,"snaptrim_duration":17.866946301999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"36'624","reported_seq":689,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.528629+0000","last_change":"2024-05-09T12:29:58.528687+0000","last_active":"2024-05-09T12:29:58.528629+0000","last_peered":"2024-05-09T12:29:58.528629+0000","last_clean":"2024-05-09T12:29:58.528629+0000","last_became_active":"2024-05-09T12:20:20.633810+0000","last_became_peered":"2024-05-09T12:20:20.633810+0000","last_unstale":"2024-05-09T12:29:58.528629+0000","last_undegraded":"2024-05-09T12:29:58.528629+0000","last_fullsized":"2024-05-09T12:29:58.528629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'624","last_scrub_stamp":"2024-05-09T12:29:58.528521+0000","last_deep_scrub":"36'624","last_deep_scrub_stamp":"2024-05-09T12:29:58.528521+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.528521+0000","objects_scrubbed":1,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:15.880722+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":4388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"36'3281","reported_seq":2665,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.549307+0000","last_change":"2024-05-09T12:29:55.549307+0000","last_active":"2024-05-09T12:29:55.549307+0000","last_peered":"2024-05-09T12:29:55.549307+0000","last_clean":"2024-05-09T12:29:55.549307+0000","last_became_active":"2024-05-09T12:20:21.638628+0000","last_became_peered":"2024-05-09T12:20:21.638628+0000","last_unstale":"2024-05-09T12:29:55.549307+0000","last_undegraded":"2024-05-09T12:29:55.549307+0000","last_fullsized":"2024-05-09T12:29:55.549307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3281","last_scrub_stamp":"2024-05-09T12:29:55.549229+0000","last_deep_scrub":"36'3281","last_deep_scrub_stamp":"2024-05-09T12:29:55.549229+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.549229+0000","objects_scrubbed":1,"log_size":3281,"log_dups_size":0,"ondisk_log_size":3281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:14:17.270656+0000","scrub_duration":5,"objects_trimmed":688,"snaptrim_duration":17.863695927999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'62","reported_seq":127,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:03.525184+0000","last_change":"2024-05-09T12:30:03.525219+0000","last_active":"2024-05-09T12:30:03.525184+0000","last_peered":"2024-05-09T12:30:03.525184+0000","last_clean":"2024-05-09T12:30:03.525184+0000","last_became_active":"2024-05-09T12:20:20.636563+0000","last_became_peered":"2024-05-09T12:20:20.636563+0000","last_unstale":"2024-05-09T12:30:03.525184+0000","last_undegraded":"2024-05-09T12:30:03.525184+0000","last_fullsized":"2024-05-09T12:30:03.525184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'62","last_scrub_stamp":"2024-05-09T12:30:03.525108+0000","last_deep_scrub":"36'62","last_deep_scrub_stamp":"2024-05-09T12:30:03.525108+0000","last_clean_scrub_stamp":"2024-05-09T12:30:03.525108+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:25:43.897905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":75,"num_write_kb":9466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31817,"num_omap_keys":53,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"35'1486","reported_seq":1551,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934158+0000","last_change":"2024-05-09T12:29:46.080811+0000","last_active":"2024-05-09T12:29:54.934158+0000","last_peered":"2024-05-09T12:29:54.934158+0000","last_clean":"2024-05-09T12:29:54.934158+0000","last_became_active":"2024-05-09T12:20:20.631617+0000","last_became_peered":"2024-05-09T12:20:20.631617+0000","last_unstale":"2024-05-09T12:29:54.934158+0000","last_undegraded":"2024-05-09T12:29:54.934158+0000","last_fullsized":"2024-05-09T12:29:54.934158+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1486","last_scrub_stamp":"2024-05-09T12:29:46.080643+0000","last_deep_scrub":"35'1486","last_deep_scrub_stamp":"2024-05-09T12:29:46.080643+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.080643+0000","objects_scrubbed":2,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:56:35.795362+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"35'3245","reported_seq":2634,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935866+0000","last_change":"2024-05-09T12:29:48.480046+0000","last_active":"2024-05-09T12:29:54.935866+0000","last_peered":"2024-05-09T12:29:54.935866+0000","last_clean":"2024-05-09T12:29:54.935866+0000","last_became_active":"2024-05-09T12:20:21.636356+0000","last_became_peered":"2024-05-09T12:20:21.636356+0000","last_unstale":"2024-05-09T12:29:54.935866+0000","last_undegraded":"2024-05-09T12:29:54.935866+0000","last_fullsized":"2024-05-09T12:29:54.935866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3245","last_scrub_stamp":"2024-05-09T12:29:48.479869+0000","last_deep_scrub":"35'3245","last_deep_scrub_stamp":"2024-05-09T12:29:48.479869+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.479869+0000","objects_scrubbed":4,"log_size":3245,"log_dups_size":0,"ondisk_log_size":3245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:26.727632+0000","scrub_duration":9,"objects_trimmed":679,"snaptrim_duration":16.543114377999999,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"34'2806","reported_seq":2871,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935914+0000","last_change":"2024-05-09T12:29:43.157253+0000","last_active":"2024-05-09T12:29:54.935914+0000","last_peered":"2024-05-09T12:29:54.935914+0000","last_clean":"2024-05-09T12:29:54.935914+0000","last_became_active":"2024-05-09T12:20:20.629218+0000","last_became_peered":"2024-05-09T12:20:20.629218+0000","last_unstale":"2024-05-09T12:29:54.935914+0000","last_undegraded":"2024-05-09T12:29:54.935914+0000","last_fullsized":"2024-05-09T12:29:54.935914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2806","last_scrub_stamp":"2024-05-09T12:29:43.157147+0000","last_deep_scrub":"34'2806","last_deep_scrub_stamp":"2024-05-09T12:29:43.157147+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.157147+0000","objects_scrubbed":3,"log_size":2806,"log_dups_size":0,"ondisk_log_size":2806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:33.813160+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2801,"num_write_kb":13041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'3359","reported_seq":2739,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:05.125182+0000","last_change":"2024-05-09T12:30:05.125212+0000","last_active":"2024-05-09T12:30:05.125182+0000","last_peered":"2024-05-09T12:30:05.125182+0000","last_clean":"2024-05-09T12:30:05.125182+0000","last_became_active":"2024-05-09T12:21:10.895672+0000","last_became_peered":"2024-05-09T12:21:10.895672+0000","last_unstale":"2024-05-09T12:30:05.125182+0000","last_undegraded":"2024-05-09T12:30:05.125182+0000","last_fullsized":"2024-05-09T12:30:05.125182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3359","last_scrub_stamp":"2024-05-09T12:30:05.125092+0000","last_deep_scrub":"36'3359","last_deep_scrub_stamp":"2024-05-09T12:30:05.125092+0000","last_clean_scrub_stamp":"2024-05-09T12:30:05.125092+0000","objects_scrubbed":2,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:46.460847+0000","scrub_duration":6,"objects_trimmed":669,"snaptrim_duration":14.259352838,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'6802","reported_seq":6867,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.569343+0000","last_change":"2024-05-09T12:29:55.569381+0000","last_active":"2024-05-09T12:29:55.569343+0000","last_peered":"2024-05-09T12:29:55.569343+0000","last_clean":"2024-05-09T12:29:55.569343+0000","last_became_active":"2024-05-09T12:20:20.636671+0000","last_became_peered":"2024-05-09T12:20:20.636671+0000","last_unstale":"2024-05-09T12:29:55.569343+0000","last_undegraded":"2024-05-09T12:29:55.569343+0000","last_fullsized":"2024-05-09T12:29:55.569343+0000","mapping_epoch":14,"log_start":"19'1200","ondisk_log_start":"19'1200","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6802","last_scrub_stamp":"2024-05-09T12:29:55.569273+0000","last_deep_scrub":"36'6802","last_deep_scrub_stamp":"2024-05-09T12:29:55.569273+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.569273+0000","objects_scrubbed":8,"log_size":5602,"log_dups_size":0,"ondisk_log_size":5602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:14:17.290700+0000","scrub_duration":62,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971743,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6801,"num_write_kb":27910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"35'3261","reported_seq":2642,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937839+0000","last_change":"2024-05-09T12:29:54.153740+0000","last_active":"2024-05-09T12:29:54.937839+0000","last_peered":"2024-05-09T12:29:54.937839+0000","last_clean":"2024-05-09T12:29:54.937839+0000","last_became_active":"2024-05-09T12:20:21.630603+0000","last_became_peered":"2024-05-09T12:20:21.630603+0000","last_unstale":"2024-05-09T12:29:54.937839+0000","last_undegraded":"2024-05-09T12:29:54.937839+0000","last_fullsized":"2024-05-09T12:29:54.937839+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3261","last_scrub_stamp":"2024-05-09T12:29:54.153600+0000","last_deep_scrub":"35'3261","last_deep_scrub_stamp":"2024-05-09T12:29:54.153600+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.153600+0000","objects_scrubbed":2,"log_size":3261,"log_dups_size":0,"ondisk_log_size":3261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:16.467698+0000","scrub_duration":6,"objects_trimmed":676,"snaptrim_duration":14.264500269999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'1924","reported_seq":1989,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:01.513983+0000","last_change":"2024-05-09T12:30:01.514019+0000","last_active":"2024-05-09T12:30:01.513983+0000","last_peered":"2024-05-09T12:30:01.513983+0000","last_clean":"2024-05-09T12:30:01.513983+0000","last_became_active":"2024-05-09T12:20:20.634338+0000","last_became_peered":"2024-05-09T12:20:20.634338+0000","last_unstale":"2024-05-09T12:30:01.513983+0000","last_undegraded":"2024-05-09T12:30:01.513983+0000","last_fullsized":"2024-05-09T12:30:01.513983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1924","last_scrub_stamp":"2024-05-09T12:30:01.513898+0000","last_deep_scrub":"36'1924","last_deep_scrub_stamp":"2024-05-09T12:30:01.513898+0000","last_clean_scrub_stamp":"2024-05-09T12:30:01.513898+0000","objects_scrubbed":3,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.820298+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1922,"num_write_kb":14500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'3063","reported_seq":2500,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:01.581070+0000","last_change":"2024-05-09T12:30:01.581114+0000","last_active":"2024-05-09T12:30:01.581070+0000","last_peered":"2024-05-09T12:30:01.581070+0000","last_clean":"2024-05-09T12:30:01.581070+0000","last_became_active":"2024-05-09T12:20:21.639845+0000","last_became_peered":"2024-05-09T12:20:21.639845+0000","last_unstale":"2024-05-09T12:30:01.581070+0000","last_undegraded":"2024-05-09T12:30:01.581070+0000","last_fullsized":"2024-05-09T12:30:01.581070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3063","last_scrub_stamp":"2024-05-09T12:30:01.580987+0000","last_deep_scrub":"36'3063","last_deep_scrub_stamp":"2024-05-09T12:30:01.580987+0000","last_clean_scrub_stamp":"2024-05-09T12:30:01.580987+0000","objects_scrubbed":2,"log_size":3063,"log_dups_size":0,"ondisk_log_size":3063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:20:51.845920+0000","scrub_duration":5,"objects_trimmed":623,"snaptrim_duration":17.859866361000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1150,"num_write_kb":595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"34'4540","reported_seq":4605,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934526+0000","last_change":"2024-05-09T12:29:44.564443+0000","last_active":"2024-05-09T12:29:54.934526+0000","last_peered":"2024-05-09T12:29:54.934526+0000","last_clean":"2024-05-09T12:29:54.934526+0000","last_became_active":"2024-05-09T12:20:20.633390+0000","last_became_peered":"2024-05-09T12:20:20.633390+0000","last_unstale":"2024-05-09T12:29:54.934526+0000","last_undegraded":"2024-05-09T12:29:54.934526+0000","last_fullsized":"2024-05-09T12:29:54.934526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4540","last_scrub_stamp":"2024-05-09T12:29:44.564290+0000","last_deep_scrub":"34'4540","last_deep_scrub_stamp":"2024-05-09T12:29:44.564290+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.564290+0000","objects_scrubbed":5,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:07.088134+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4528,"num_write_kb":29748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":840,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'3315","reported_seq":2662,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:05.519664+0000","last_change":"2024-05-09T12:30:05.519720+0000","last_active":"2024-05-09T12:30:05.519664+0000","last_peered":"2024-05-09T12:30:05.519664+0000","last_clean":"2024-05-09T12:30:05.519664+0000","last_became_active":"2024-05-09T12:20:21.638605+0000","last_became_peered":"2024-05-09T12:20:21.638605+0000","last_unstale":"2024-05-09T12:30:05.519664+0000","last_undegraded":"2024-05-09T12:30:05.519664+0000","last_fullsized":"2024-05-09T12:30:05.519664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3315","last_scrub_stamp":"2024-05-09T12:30:05.519570+0000","last_deep_scrub":"36'3315","last_deep_scrub_stamp":"2024-05-09T12:30:05.519570+0000","last_clean_scrub_stamp":"2024-05-09T12:30:05.519570+0000","objects_scrubbed":4,"log_size":3315,"log_dups_size":0,"ondisk_log_size":3315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:44:35.788368+0000","scrub_duration":9,"objects_trimmed":704,"snaptrim_duration":16.551154678,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'3407","reported_seq":3472,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.530952+0000","last_change":"2024-05-09T12:29:57.530996+0000","last_active":"2024-05-09T12:29:57.530952+0000","last_peered":"2024-05-09T12:29:57.530952+0000","last_clean":"2024-05-09T12:29:57.530952+0000","last_became_active":"2024-05-09T12:20:20.632573+0000","last_became_peered":"2024-05-09T12:20:20.632573+0000","last_unstale":"2024-05-09T12:29:57.530952+0000","last_undegraded":"2024-05-09T12:29:57.530952+0000","last_fullsized":"2024-05-09T12:29:57.530952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3407","last_scrub_stamp":"2024-05-09T12:29:57.530810+0000","last_deep_scrub":"36'3407","last_deep_scrub_stamp":"2024-05-09T12:29:57.530810+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.530810+0000","objects_scrubbed":3,"log_size":3407,"log_dups_size":0,"ondisk_log_size":3407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:35.738376+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3399,"num_write_kb":27007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'3251","reported_seq":2646,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:08.504775+0000","last_change":"2024-05-09T12:30:08.504822+0000","last_active":"2024-05-09T12:30:08.504775+0000","last_peered":"2024-05-09T12:30:08.504775+0000","last_clean":"2024-05-09T12:30:08.504775+0000","last_became_active":"2024-05-09T12:20:21.642648+0000","last_became_peered":"2024-05-09T12:20:21.642648+0000","last_unstale":"2024-05-09T12:30:08.504775+0000","last_undegraded":"2024-05-09T12:30:08.504775+0000","last_fullsized":"2024-05-09T12:30:08.504775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3251","last_scrub_stamp":"2024-05-09T12:30:08.504672+0000","last_deep_scrub":"34'3251","last_deep_scrub_stamp":"2024-05-09T12:30:08.504672+0000","last_clean_scrub_stamp":"2024-05-09T12:30:08.504672+0000","objects_scrubbed":0,"log_size":3251,"log_dups_size":0,"ondisk_log_size":3251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:53:33.429251+0000","scrub_duration":2,"objects_trimmed":697,"snaptrim_duration":16.554026155999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"36'1861","reported_seq":1926,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:02.530585+0000","last_change":"2024-05-09T12:30:02.530625+0000","last_active":"2024-05-09T12:30:02.530585+0000","last_peered":"2024-05-09T12:30:02.530585+0000","last_clean":"2024-05-09T12:30:02.530585+0000","last_became_active":"2024-05-09T12:20:20.634407+0000","last_became_peered":"2024-05-09T12:20:20.634407+0000","last_unstale":"2024-05-09T12:30:02.530585+0000","last_undegraded":"2024-05-09T12:30:02.530585+0000","last_fullsized":"2024-05-09T12:30:02.530585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1861","last_scrub_stamp":"2024-05-09T12:30:02.530484+0000","last_deep_scrub":"36'1861","last_deep_scrub_stamp":"2024-05-09T12:30:02.530484+0000","last_clean_scrub_stamp":"2024-05-09T12:30:02.530484+0000","objects_scrubbed":6,"log_size":1861,"log_dups_size":0,"ondisk_log_size":1861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:26:45.827290+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":18629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1429429,"num_omap_keys":2836,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"36'3362","reported_seq":2705,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:57.102696+0000","last_change":"2024-05-09T12:29:57.102731+0000","last_active":"2024-05-09T12:29:57.102696+0000","last_peered":"2024-05-09T12:29:57.102696+0000","last_clean":"2024-05-09T12:29:57.102696+0000","last_became_active":"2024-05-09T12:20:21.630607+0000","last_became_peered":"2024-05-09T12:20:21.630607+0000","last_unstale":"2024-05-09T12:29:57.102696+0000","last_undegraded":"2024-05-09T12:29:57.102696+0000","last_fullsized":"2024-05-09T12:29:57.102696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3362","last_scrub_stamp":"2024-05-09T12:29:57.102614+0000","last_deep_scrub":"36'3362","last_deep_scrub_stamp":"2024-05-09T12:29:57.102614+0000","last_clean_scrub_stamp":"2024-05-09T12:29:57.102614+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:32.005466+0000","scrub_duration":8,"objects_trimmed":703,"snaptrim_duration":14.257684298999999,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1267,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"35'179","reported_seq":244,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934382+0000","last_change":"2024-05-09T12:29:48.462795+0000","last_active":"2024-05-09T12:29:54.934382+0000","last_peered":"2024-05-09T12:29:54.934382+0000","last_clean":"2024-05-09T12:29:54.934382+0000","last_became_active":"2024-05-09T12:20:20.633635+0000","last_became_peered":"2024-05-09T12:20:20.633635+0000","last_unstale":"2024-05-09T12:29:54.934382+0000","last_undegraded":"2024-05-09T12:29:54.934382+0000","last_fullsized":"2024-05-09T12:29:54.934382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'179","last_scrub_stamp":"2024-05-09T12:29:48.462659+0000","last_deep_scrub":"35'179","last_deep_scrub_stamp":"2024-05-09T12:29:48.462659+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.462659+0000","objects_scrubbed":1,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:37:46.686864+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'3235","reported_seq":2627,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.538628+0000","last_change":"2024-05-09T12:29:55.538656+0000","last_active":"2024-05-09T12:29:55.538628+0000","last_peered":"2024-05-09T12:29:55.538628+0000","last_clean":"2024-05-09T12:29:55.538628+0000","last_became_active":"2024-05-09T12:20:21.632168+0000","last_became_peered":"2024-05-09T12:20:21.632168+0000","last_unstale":"2024-05-09T12:29:55.538628+0000","last_undegraded":"2024-05-09T12:29:55.538628+0000","last_fullsized":"2024-05-09T12:29:55.538628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3235","last_scrub_stamp":"2024-05-09T12:29:55.538558+0000","last_deep_scrub":"36'3235","last_deep_scrub_stamp":"2024-05-09T12:29:55.538558+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.538558+0000","objects_scrubbed":3,"log_size":3235,"log_dups_size":0,"ondisk_log_size":3235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:03.124462+0000","scrub_duration":8,"objects_trimmed":690,"snaptrim_duration":15.317930050999999,"stat_sum":{"num_bytes":4110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936172+0000","last_change":"2024-05-09T12:29:44.462498+0000","last_active":"2024-05-09T12:29:54.936172+0000","last_peered":"2024-05-09T12:29:54.936172+0000","last_clean":"2024-05-09T12:29:54.936172+0000","last_became_active":"2024-05-09T12:20:16.099838+0000","last_became_peered":"2024-05-09T12:20:16.099838+0000","last_unstale":"2024-05-09T12:29:54.936172+0000","last_undegraded":"2024-05-09T12:29:54.936172+0000","last_fullsized":"2024-05-09T12:29:54.936172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:44.462394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:44.462394+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.462394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:18.128022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4950","reported_seq":5015,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935366+0000","last_change":"2024-05-09T12:29:42.606358+0000","last_active":"2024-05-09T12:29:54.935366+0000","last_peered":"2024-05-09T12:29:54.935366+0000","last_clean":"2024-05-09T12:29:54.935366+0000","last_became_active":"2024-05-09T12:20:20.632603+0000","last_became_peered":"2024-05-09T12:20:20.632603+0000","last_unstale":"2024-05-09T12:29:54.935366+0000","last_undegraded":"2024-05-09T12:29:54.935366+0000","last_fullsized":"2024-05-09T12:29:54.935366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4950","last_scrub_stamp":"2024-05-09T12:29:42.606121+0000","last_deep_scrub":"34'4950","last_deep_scrub_stamp":"2024-05-09T12:29:42.606121+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.606121+0000","objects_scrubbed":6,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:00.977528+0000","scrub_duration":105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4942,"num_write_kb":32277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'3218","reported_seq":2630,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:09.455498+0000","last_change":"2024-05-09T12:30:09.455525+0000","last_active":"2024-05-09T12:30:09.455498+0000","last_peered":"2024-05-09T12:30:09.455498+0000","last_clean":"2024-05-09T12:30:09.455498+0000","last_became_active":"2024-05-09T12:20:21.642255+0000","last_became_peered":"2024-05-09T12:20:21.642255+0000","last_unstale":"2024-05-09T12:30:09.455498+0000","last_undegraded":"2024-05-09T12:30:09.455498+0000","last_fullsized":"2024-05-09T12:30:09.455498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3218","last_scrub_stamp":"2024-05-09T12:30:09.455382+0000","last_deep_scrub":"34'3218","last_deep_scrub_stamp":"2024-05-09T12:30:09.455382+0000","last_clean_scrub_stamp":"2024-05-09T12:30:09.455382+0000","objects_scrubbed":0,"log_size":3218,"log_dups_size":0,"ondisk_log_size":3218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T23:09:53.598479+0000","scrub_duration":2,"objects_trimmed":655,"snaptrim_duration":16.555241055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934428+0000","last_change":"2024-05-09T12:29:43.468348+0000","last_active":"2024-05-09T12:29:54.934428+0000","last_peered":"2024-05-09T12:29:54.934428+0000","last_clean":"2024-05-09T12:29:54.934428+0000","last_became_active":"2024-05-09T12:20:16.099830+0000","last_became_peered":"2024-05-09T12:20:16.099830+0000","last_unstale":"2024-05-09T12:29:54.934428+0000","last_undegraded":"2024-05-09T12:29:54.934428+0000","last_fullsized":"2024-05-09T12:29:54.934428+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:43.468219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:43.468219+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.468219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:31:35.078963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"35'1015","reported_seq":1080,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934358+0000","last_change":"2024-05-09T12:29:50.197716+0000","last_active":"2024-05-09T12:29:54.934358+0000","last_peered":"2024-05-09T12:29:54.934358+0000","last_clean":"2024-05-09T12:29:54.934358+0000","last_became_active":"2024-05-09T12:20:20.631457+0000","last_became_peered":"2024-05-09T12:20:20.631457+0000","last_unstale":"2024-05-09T12:29:54.934358+0000","last_undegraded":"2024-05-09T12:29:54.934358+0000","last_fullsized":"2024-05-09T12:29:54.934358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'1015","last_scrub_stamp":"2024-05-09T12:29:50.197589+0000","last_deep_scrub":"35'1015","last_deep_scrub_stamp":"2024-05-09T12:29:50.197589+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.197589+0000","objects_scrubbed":3,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:06:33.094112+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":12765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"34'3181","reported_seq":2575,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935528+0000","last_change":"2024-05-09T12:29:46.469524+0000","last_active":"2024-05-09T12:29:54.935528+0000","last_peered":"2024-05-09T12:29:54.935528+0000","last_clean":"2024-05-09T12:29:54.935528+0000","last_became_active":"2024-05-09T12:20:21.633340+0000","last_became_peered":"2024-05-09T12:20:21.633340+0000","last_unstale":"2024-05-09T12:29:54.935528+0000","last_undegraded":"2024-05-09T12:29:54.935528+0000","last_fullsized":"2024-05-09T12:29:54.935528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3181","last_scrub_stamp":"2024-05-09T12:29:46.469384+0000","last_deep_scrub":"34'3181","last_deep_scrub_stamp":"2024-05-09T12:29:46.469384+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.469384+0000","objects_scrubbed":0,"log_size":3181,"log_dups_size":0,"ondisk_log_size":3181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:08.402105+0000","scrub_duration":2,"objects_trimmed":671,"snaptrim_duration":15.326463444,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.938104+0000","last_change":"2024-05-09T12:29:42.121685+0000","last_active":"2024-05-09T12:29:54.938104+0000","last_peered":"2024-05-09T12:29:54.938104+0000","last_clean":"2024-05-09T12:29:54.938104+0000","last_became_active":"2024-05-09T12:20:16.099941+0000","last_became_peered":"2024-05-09T12:20:16.099941+0000","last_unstale":"2024-05-09T12:29:54.938104+0000","last_undegraded":"2024-05-09T12:29:54.938104+0000","last_fullsized":"2024-05-09T12:29:54.938104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:42.121580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:42.121580+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.121580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:04.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'4166","reported_seq":4231,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934433+0000","last_change":"2024-05-09T12:29:49.472781+0000","last_active":"2024-05-09T12:29:54.934433+0000","last_peered":"2024-05-09T12:29:54.934433+0000","last_clean":"2024-05-09T12:29:54.934433+0000","last_became_active":"2024-05-09T12:20:20.634096+0000","last_became_peered":"2024-05-09T12:20:20.634096+0000","last_unstale":"2024-05-09T12:29:54.934433+0000","last_undegraded":"2024-05-09T12:29:54.934433+0000","last_fullsized":"2024-05-09T12:29:54.934433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4166","last_scrub_stamp":"2024-05-09T12:29:49.472659+0000","last_deep_scrub":"35'4166","last_deep_scrub_stamp":"2024-05-09T12:29:49.472659+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.472659+0000","objects_scrubbed":2,"log_size":4166,"log_dups_size":0,"ondisk_log_size":4166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:59.638224+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4158,"num_write_kb":18519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":664814,"num_omap_keys":1318,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'3122","reported_seq":2544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935459+0000","last_change":"2024-05-09T12:29:47.428277+0000","last_active":"2024-05-09T12:29:54.935459+0000","last_peered":"2024-05-09T12:29:54.935459+0000","last_clean":"2024-05-09T12:29:54.935459+0000","last_became_active":"2024-05-09T12:20:21.632560+0000","last_became_peered":"2024-05-09T12:20:21.632560+0000","last_unstale":"2024-05-09T12:29:54.935459+0000","last_undegraded":"2024-05-09T12:29:54.935459+0000","last_fullsized":"2024-05-09T12:29:54.935459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3122","last_scrub_stamp":"2024-05-09T12:29:47.428180+0000","last_deep_scrub":"35'3122","last_deep_scrub_stamp":"2024-05-09T12:29:47.428180+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.428180+0000","objects_scrubbed":4,"log_size":3122,"log_dups_size":0,"ondisk_log_size":3122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:27.867052+0000","scrub_duration":9,"objects_trimmed":681,"snaptrim_duration":15.705157161000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934984+0000","last_change":"2024-05-09T12:29:41.485081+0000","last_active":"2024-05-09T12:29:54.934984+0000","last_peered":"2024-05-09T12:29:54.934984+0000","last_clean":"2024-05-09T12:29:54.934984+0000","last_became_active":"2024-05-09T12:20:15.588828+0000","last_became_peered":"2024-05-09T12:20:15.588828+0000","last_unstale":"2024-05-09T12:29:54.934984+0000","last_undegraded":"2024-05-09T12:29:54.934984+0000","last_fullsized":"2024-05-09T12:29:54.934984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.484958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.484958+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.484958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:14.472742+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"35'74","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936252+0000","last_change":"2024-05-09T12:29:45.510456+0000","last_active":"2024-05-09T12:29:54.936252+0000","last_peered":"2024-05-09T12:29:54.936252+0000","last_clean":"2024-05-09T12:29:54.936252+0000","last_became_active":"2024-05-09T12:20:16.597154+0000","last_became_peered":"2024-05-09T12:20:16.597154+0000","last_unstale":"2024-05-09T12:29:54.936252+0000","last_undegraded":"2024-05-09T12:29:54.936252+0000","last_fullsized":"2024-05-09T12:29:54.936252+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-05-09T12:29:45.510351+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-05-09T12:29:45.510351+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.510351+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:03:59.251487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2648","reported_seq":2840,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508088+0000","last_change":"2024-05-09T12:29:39.583785+0000","last_active":"2024-05-09T12:29:55.508088+0000","last_peered":"2024-05-09T12:29:55.508088+0000","last_clean":"2024-05-09T12:29:55.508088+0000","last_became_active":"2024-05-09T12:20:20.626500+0000","last_became_peered":"2024-05-09T12:20:20.626500+0000","last_unstale":"2024-05-09T12:29:55.508088+0000","last_undegraded":"2024-05-09T12:29:55.508088+0000","last_fullsized":"2024-05-09T12:29:55.508088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2648","last_scrub_stamp":"2024-05-09T12:29:39.583261+0000","last_deep_scrub":"34'2648","last_deep_scrub_stamp":"2024-05-09T12:29:39.583261+0000","last_clean_scrub_stamp":"2024-05-09T12:29:39.583261+0000","objects_scrubbed":5,"log_size":2648,"log_dups_size":0,"ondisk_log_size":2648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:30:43.939844+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15737865,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":126,"num_read_kb":3170,"num_write":2641,"num_write_kb":16426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"35'3227","reported_seq":2644,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508929+0000","last_change":"2024-05-09T12:29:48.542236+0000","last_active":"2024-05-09T12:29:55.508929+0000","last_peered":"2024-05-09T12:29:55.508929+0000","last_clean":"2024-05-09T12:29:55.508929+0000","last_became_active":"2024-05-09T12:20:21.633935+0000","last_became_peered":"2024-05-09T12:20:21.633935+0000","last_unstale":"2024-05-09T12:29:55.508929+0000","last_undegraded":"2024-05-09T12:29:55.508929+0000","last_fullsized":"2024-05-09T12:29:55.508929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3227","last_scrub_stamp":"2024-05-09T12:29:48.542135+0000","last_deep_scrub":"35'3227","last_deep_scrub_stamp":"2024-05-09T12:29:48.542135+0000","last_clean_scrub_stamp":"2024-05-09T12:29:48.542135+0000","objects_scrubbed":5,"log_size":3227,"log_dups_size":0,"ondisk_log_size":3227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:26.789898+0000","scrub_duration":10,"objects_trimmed":628,"snaptrim_duration":17.866315191999998,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"34'1375","reported_seq":1440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509080+0000","last_change":"2024-05-09T12:29:42.589441+0000","last_active":"2024-05-09T12:29:55.509080+0000","last_peered":"2024-05-09T12:29:55.509080+0000","last_clean":"2024-05-09T12:29:55.509080+0000","last_became_active":"2024-05-09T12:20:20.629778+0000","last_became_peered":"2024-05-09T12:20:20.629778+0000","last_unstale":"2024-05-09T12:29:55.509080+0000","last_undegraded":"2024-05-09T12:29:55.509080+0000","last_fullsized":"2024-05-09T12:29:55.509080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1375","last_scrub_stamp":"2024-05-09T12:29:42.589306+0000","last_deep_scrub":"34'1375","last_deep_scrub_stamp":"2024-05-09T12:29:42.589306+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.589306+0000","objects_scrubbed":4,"log_size":1375,"log_dups_size":0,"ondisk_log_size":1375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:11:47.850394+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11350522,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":14192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935473+0000","last_change":"2024-05-09T12:29:40.529917+0000","last_active":"2024-05-09T12:29:54.935473+0000","last_peered":"2024-05-09T12:29:54.935473+0000","last_clean":"2024-05-09T12:29:54.935473+0000","last_became_active":"2024-05-09T12:20:15.586524+0000","last_became_peered":"2024-05-09T12:20:15.586524+0000","last_unstale":"2024-05-09T12:29:54.935473+0000","last_undegraded":"2024-05-09T12:29:54.935473+0000","last_fullsized":"2024-05-09T12:29:54.935473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:40.529784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:40.529784+0000","last_clean_scrub_stamp":"2024-05-09T12:29:40.529784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:24:09.324077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'3065","reported_seq":2469,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.122225+0000","last_change":"2024-05-09T12:29:55.122260+0000","last_active":"2024-05-09T12:29:55.122225+0000","last_peered":"2024-05-09T12:29:55.122225+0000","last_clean":"2024-05-09T12:29:55.122225+0000","last_became_active":"2024-05-09T12:20:21.630764+0000","last_became_peered":"2024-05-09T12:20:21.630764+0000","last_unstale":"2024-05-09T12:29:55.122225+0000","last_undegraded":"2024-05-09T12:29:55.122225+0000","last_fullsized":"2024-05-09T12:29:55.122225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3065","last_scrub_stamp":"2024-05-09T12:29:55.122145+0000","last_deep_scrub":"36'3065","last_deep_scrub_stamp":"2024-05-09T12:29:55.122145+0000","last_clean_scrub_stamp":"2024-05-09T12:29:55.122145+0000","objects_scrubbed":4,"log_size":3065,"log_dups_size":0,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:28.787773+0000","scrub_duration":9,"objects_trimmed":661,"snaptrim_duration":14.258482733999999,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"35'31","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935598+0000","last_change":"2024-05-09T12:29:51.490083+0000","last_active":"2024-05-09T12:29:54.935598+0000","last_peered":"2024-05-09T12:29:54.935598+0000","last_clean":"2024-05-09T12:29:54.935598+0000","last_became_active":"2024-05-09T12:20:20.634833+0000","last_became_peered":"2024-05-09T12:20:20.634833+0000","last_unstale":"2024-05-09T12:29:54.935598+0000","last_undegraded":"2024-05-09T12:29:54.935598+0000","last_fullsized":"2024-05-09T12:29:54.935598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'31","last_scrub_stamp":"2024-05-09T12:29:51.489925+0000","last_deep_scrub":"35'31","last_deep_scrub_stamp":"2024-05-09T12:29:51.489925+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.489925+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:05.975229+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":33,"num_write_kb":8882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671934,"num_omap_keys":1333,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935270+0000","last_change":"2024-05-09T12:29:41.082063+0000","last_active":"2024-05-09T12:29:54.935270+0000","last_peered":"2024-05-09T12:29:54.935270+0000","last_clean":"2024-05-09T12:29:54.935270+0000","last_became_active":"2024-05-09T12:20:16.099813+0000","last_became_peered":"2024-05-09T12:20:16.099813+0000","last_unstale":"2024-05-09T12:29:54.935270+0000","last_undegraded":"2024-05-09T12:29:54.935270+0000","last_fullsized":"2024-05-09T12:29:54.935270+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.081937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.081937+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.081937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:12:52.067155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"35'3327","reported_seq":2657,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508171+0000","last_change":"2024-05-09T12:29:52.528459+0000","last_active":"2024-05-09T12:29:55.508171+0000","last_peered":"2024-05-09T12:29:55.508171+0000","last_clean":"2024-05-09T12:29:55.508171+0000","last_became_active":"2024-05-09T12:20:21.636192+0000","last_became_peered":"2024-05-09T12:20:21.636192+0000","last_unstale":"2024-05-09T12:29:55.508171+0000","last_undegraded":"2024-05-09T12:29:55.508171+0000","last_fullsized":"2024-05-09T12:29:55.508171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3327","last_scrub_stamp":"2024-05-09T12:29:52.528373+0000","last_deep_scrub":"35'3327","last_deep_scrub_stamp":"2024-05-09T12:29:52.528373+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.528373+0000","objects_scrubbed":1,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:05.443099+0000","scrub_duration":5,"objects_trimmed":534,"snaptrim_duration":17.853180898000002,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1229,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"32'27","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935367+0000","last_change":"2024-05-09T12:29:45.506656+0000","last_active":"2024-05-09T12:29:54.935367+0000","last_peered":"2024-05-09T12:29:54.935367+0000","last_clean":"2024-05-09T12:29:54.935367+0000","last_became_active":"2024-05-09T12:20:20.632492+0000","last_became_peered":"2024-05-09T12:20:20.632492+0000","last_unstale":"2024-05-09T12:29:54.935367+0000","last_undegraded":"2024-05-09T12:29:54.935367+0000","last_fullsized":"2024-05-09T12:29:54.935367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-05-09T12:29:45.506513+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-05-09T12:29:45.506513+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.506513+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:12:56.491731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936880+0000","last_change":"2024-05-09T12:29:42.423550+0000","last_active":"2024-05-09T12:29:54.936880+0000","last_peered":"2024-05-09T12:29:54.936880+0000","last_clean":"2024-05-09T12:29:54.936880+0000","last_became_active":"2024-05-09T12:20:16.099751+0000","last_became_peered":"2024-05-09T12:20:16.099751+0000","last_unstale":"2024-05-09T12:29:54.936880+0000","last_undegraded":"2024-05-09T12:29:54.936880+0000","last_fullsized":"2024-05-09T12:29:54.936880+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:42.423421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:42.423421+0000","last_clean_scrub_stamp":"2024-05-09T12:29:42.423421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:53.752300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"36'3469","reported_seq":2837,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.557507+0000","last_change":"2024-05-09T12:29:59.557553+0000","last_active":"2024-05-09T12:29:59.557507+0000","last_peered":"2024-05-09T12:29:59.557507+0000","last_clean":"2024-05-09T12:29:59.557507+0000","last_became_active":"2024-05-09T12:20:21.639267+0000","last_became_peered":"2024-05-09T12:20:21.639267+0000","last_unstale":"2024-05-09T12:29:59.557507+0000","last_undegraded":"2024-05-09T12:29:59.557507+0000","last_fullsized":"2024-05-09T12:29:59.557507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3469","last_scrub_stamp":"2024-05-09T12:29:59.557413+0000","last_deep_scrub":"36'3469","last_deep_scrub_stamp":"2024-05-09T12:29:59.557413+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.557413+0000","objects_scrubbed":2,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:30.650731+0000","scrub_duration":6,"objects_trimmed":729,"snaptrim_duration":17.860915869999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'2128","reported_seq":2193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934996+0000","last_change":"2024-05-09T12:29:52.127015+0000","last_active":"2024-05-09T12:29:54.934996+0000","last_peered":"2024-05-09T12:29:54.934996+0000","last_clean":"2024-05-09T12:29:54.934996+0000","last_became_active":"2024-05-09T12:20:20.631620+0000","last_became_peered":"2024-05-09T12:20:20.631620+0000","last_unstale":"2024-05-09T12:29:54.934996+0000","last_undegraded":"2024-05-09T12:29:54.934996+0000","last_fullsized":"2024-05-09T12:29:54.934996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2128","last_scrub_stamp":"2024-05-09T12:29:52.126878+0000","last_deep_scrub":"35'2128","last_deep_scrub_stamp":"2024-05-09T12:29:52.126878+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.126878+0000","objects_scrubbed":4,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:28.567184+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2123,"num_write_kb":21802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":539,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936898+0000","last_change":"2024-05-09T12:29:41.411436+0000","last_active":"2024-05-09T12:29:54.936898+0000","last_peered":"2024-05-09T12:29:54.936898+0000","last_clean":"2024-05-09T12:29:54.936898+0000","last_became_active":"2024-05-09T12:20:15.589564+0000","last_became_peered":"2024-05-09T12:20:15.589564+0000","last_unstale":"2024-05-09T12:29:54.936898+0000","last_undegraded":"2024-05-09T12:29:54.936898+0000","last_fullsized":"2024-05-09T12:29:54.936898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T12:29:41.411353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T12:29:41.411353+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.411353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:17.851658+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"35'3062","reported_seq":2504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934720+0000","last_change":"2024-05-09T12:29:52.466364+0000","last_active":"2024-05-09T12:29:54.934720+0000","last_peered":"2024-05-09T12:29:54.934720+0000","last_clean":"2024-05-09T12:29:54.934720+0000","last_became_active":"2024-05-09T12:20:21.630265+0000","last_became_peered":"2024-05-09T12:20:21.630265+0000","last_unstale":"2024-05-09T12:29:54.934720+0000","last_undegraded":"2024-05-09T12:29:54.934720+0000","last_fullsized":"2024-05-09T12:29:54.934720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3062","last_scrub_stamp":"2024-05-09T12:29:52.466235+0000","last_deep_scrub":"35'3062","last_deep_scrub_stamp":"2024-05-09T12:29:52.466235+0000","last_clean_scrub_stamp":"2024-05-09T12:29:52.466235+0000","objects_scrubbed":4,"log_size":3062,"log_dups_size":0,"ondisk_log_size":3062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:28.028525+0000","scrub_duration":10,"objects_trimmed":659,"snaptrim_duration":15.324016532,"stat_sum":{"num_bytes":8203,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'3269","reported_seq":2630,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.148815+0000","last_change":"2024-05-09T12:29:56.148850+0000","last_active":"2024-05-09T12:29:56.148815+0000","last_peered":"2024-05-09T12:29:56.148815+0000","last_clean":"2024-05-09T12:29:56.148815+0000","last_became_active":"2024-05-09T12:20:21.630650+0000","last_became_peered":"2024-05-09T12:20:21.630650+0000","last_unstale":"2024-05-09T12:29:56.148815+0000","last_undegraded":"2024-05-09T12:29:56.148815+0000","last_fullsized":"2024-05-09T12:29:56.148815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3269","last_scrub_stamp":"2024-05-09T12:29:56.148729+0000","last_deep_scrub":"36'3269","last_deep_scrub_stamp":"2024-05-09T12:29:56.148729+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.148729+0000","objects_scrubbed":2,"log_size":3269,"log_dups_size":0,"ondisk_log_size":3269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:04:09.889865+0000","scrub_duration":7,"objects_trimmed":718,"snaptrim_duration":14.265097418,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'5461","reported_seq":5527,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.550667+0000","last_change":"2024-05-09T12:29:59.550707+0000","last_active":"2024-05-09T12:29:59.550667+0000","last_peered":"2024-05-09T12:29:59.550667+0000","last_clean":"2024-05-09T12:29:59.550667+0000","last_became_active":"2024-05-09T12:20:20.633687+0000","last_became_peered":"2024-05-09T12:20:20.633687+0000","last_unstale":"2024-05-09T12:29:59.550667+0000","last_undegraded":"2024-05-09T12:29:59.550667+0000","last_fullsized":"2024-05-09T12:29:59.550667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5461","last_scrub_stamp":"2024-05-09T12:29:59.550593+0000","last_deep_scrub":"36'5461","last_deep_scrub_stamp":"2024-05-09T12:29:59.550593+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.550593+0000","objects_scrubbed":5,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:14.519548+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5451,"num_write_kb":26150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'3165","reported_seq":2581,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.445592+0000","last_change":"2024-05-09T12:29:59.445623+0000","last_active":"2024-05-09T12:29:59.445592+0000","last_peered":"2024-05-09T12:29:59.445592+0000","last_clean":"2024-05-09T12:29:59.445592+0000","last_became_active":"2024-05-09T12:20:21.634853+0000","last_became_peered":"2024-05-09T12:20:21.634853+0000","last_unstale":"2024-05-09T12:29:59.445592+0000","last_undegraded":"2024-05-09T12:29:59.445592+0000","last_fullsized":"2024-05-09T12:29:59.445592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3165","last_scrub_stamp":"2024-05-09T12:29:59.445530+0000","last_deep_scrub":"36'3165","last_deep_scrub_stamp":"2024-05-09T12:29:59.445530+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.445530+0000","objects_scrubbed":5,"log_size":3165,"log_dups_size":0,"ondisk_log_size":3165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:33.111158+0000","scrub_duration":9,"objects_trimmed":663,"snaptrim_duration":15.323238147,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"35'3058","reported_seq":3123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934855+0000","last_change":"2024-05-09T12:29:45.121779+0000","last_active":"2024-05-09T12:29:54.934855+0000","last_peered":"2024-05-09T12:29:54.934855+0000","last_clean":"2024-05-09T12:29:54.934855+0000","last_became_active":"2024-05-09T12:20:20.631349+0000","last_became_peered":"2024-05-09T12:20:20.631349+0000","last_unstale":"2024-05-09T12:29:54.934855+0000","last_undegraded":"2024-05-09T12:29:54.934855+0000","last_fullsized":"2024-05-09T12:29:54.934855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3058","last_scrub_stamp":"2024-05-09T12:29:45.121683+0000","last_deep_scrub":"35'3058","last_deep_scrub_stamp":"2024-05-09T12:29:45.121683+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.121683+0000","objects_scrubbed":5,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:46:49.413761+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3049,"num_write_kb":22052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":711288,"num_omap_keys":1413,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"35'3362","reported_seq":3427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.935859+0000","last_change":"2024-05-09T12:29:51.164491+0000","last_active":"2024-05-09T12:29:54.935859+0000","last_peered":"2024-05-09T12:29:54.935859+0000","last_clean":"2024-05-09T12:29:54.935859+0000","last_became_active":"2024-05-09T12:20:20.632327+0000","last_became_peered":"2024-05-09T12:20:20.632327+0000","last_unstale":"2024-05-09T12:29:54.935859+0000","last_undegraded":"2024-05-09T12:29:54.935859+0000","last_fullsized":"2024-05-09T12:29:54.935859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3362","last_scrub_stamp":"2024-05-09T12:29:51.164220+0000","last_deep_scrub":"35'3362","last_deep_scrub_stamp":"2024-05-09T12:29:51.164220+0000","last_clean_scrub_stamp":"2024-05-09T12:29:51.164220+0000","objects_scrubbed":3,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:01:58.750125+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3362,"num_write_kb":32536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673928,"num_omap_keys":1336,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"35'3409","reported_seq":2739,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.507877+0000","last_change":"2024-05-09T12:29:46.539783+0000","last_active":"2024-05-09T12:29:55.507877+0000","last_peered":"2024-05-09T12:29:55.507877+0000","last_clean":"2024-05-09T12:29:55.507877+0000","last_became_active":"2024-05-09T12:20:21.632913+0000","last_became_peered":"2024-05-09T12:20:21.632913+0000","last_unstale":"2024-05-09T12:29:55.507877+0000","last_undegraded":"2024-05-09T12:29:55.507877+0000","last_fullsized":"2024-05-09T12:29:55.507877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3409","last_scrub_stamp":"2024-05-09T12:29:46.539693+0000","last_deep_scrub":"35'3409","last_deep_scrub_stamp":"2024-05-09T12:29:46.539693+0000","last_clean_scrub_stamp":"2024-05-09T12:29:46.539693+0000","objects_scrubbed":5,"log_size":3409,"log_dups_size":0,"ondisk_log_size":3409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:37:00.644214+0000","scrub_duration":10,"objects_trimmed":671,"snaptrim_duration":17.851274162999999,"stat_sum":{"num_bytes":121,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":1274,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"34'1017","reported_seq":1082,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509370+0000","last_change":"2024-05-09T12:29:44.595295+0000","last_active":"2024-05-09T12:29:55.509370+0000","last_peered":"2024-05-09T12:29:55.509370+0000","last_clean":"2024-05-09T12:29:55.509370+0000","last_became_active":"2024-05-09T12:20:20.631681+0000","last_became_peered":"2024-05-09T12:20:20.631681+0000","last_unstale":"2024-05-09T12:29:55.509370+0000","last_undegraded":"2024-05-09T12:29:55.509370+0000","last_fullsized":"2024-05-09T12:29:55.509370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1017","last_scrub_stamp":"2024-05-09T12:29:44.595151+0000","last_deep_scrub":"34'1017","last_deep_scrub_stamp":"2024-05-09T12:29:44.595151+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.595151+0000","objects_scrubbed":3,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:41.261796+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":12763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"36'3311","reported_seq":2689,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:00.490570+0000","last_change":"2024-05-09T12:30:00.490607+0000","last_active":"2024-05-09T12:30:00.490570+0000","last_peered":"2024-05-09T12:30:00.490570+0000","last_clean":"2024-05-09T12:30:00.490570+0000","last_became_active":"2024-05-09T12:20:21.635404+0000","last_became_peered":"2024-05-09T12:20:21.635404+0000","last_unstale":"2024-05-09T12:30:00.490570+0000","last_undegraded":"2024-05-09T12:30:00.490570+0000","last_fullsized":"2024-05-09T12:30:00.490570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3311","last_scrub_stamp":"2024-05-09T12:30:00.490507+0000","last_deep_scrub":"36'3311","last_deep_scrub_stamp":"2024-05-09T12:30:00.490507+0000","last_clean_scrub_stamp":"2024-05-09T12:30:00.490507+0000","objects_scrubbed":1,"log_size":3311,"log_dups_size":0,"ondisk_log_size":3311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T00:04:14.231643+0000","scrub_duration":5,"objects_trimmed":438,"snaptrim_duration":15.292536912999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"36'3040","reported_seq":2496,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:10.468380+0000","last_change":"2024-05-09T12:30:10.468411+0000","last_active":"2024-05-09T12:30:10.468380+0000","last_peered":"2024-05-09T12:30:10.468380+0000","last_clean":"2024-05-09T12:30:10.468380+0000","last_became_active":"2024-05-09T12:20:21.643406+0000","last_became_peered":"2024-05-09T12:20:21.643406+0000","last_unstale":"2024-05-09T12:30:10.468380+0000","last_undegraded":"2024-05-09T12:30:10.468380+0000","last_fullsized":"2024-05-09T12:30:10.468380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3040","last_scrub_stamp":"2024-05-09T12:30:10.468297+0000","last_deep_scrub":"36'3040","last_deep_scrub_stamp":"2024-05-09T12:30:10.468297+0000","last_clean_scrub_stamp":"2024-05-09T12:30:10.468297+0000","objects_scrubbed":1,"log_size":3040,"log_dups_size":0,"ondisk_log_size":3040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:52.251849+0000","scrub_duration":4,"objects_trimmed":660,"snaptrim_duration":16.552079564,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2406","reported_seq":2471,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934328+0000","last_change":"2024-05-09T12:29:50.485872+0000","last_active":"2024-05-09T12:29:54.934328+0000","last_peered":"2024-05-09T12:29:54.934328+0000","last_clean":"2024-05-09T12:29:54.934328+0000","last_became_active":"2024-05-09T12:20:20.634584+0000","last_became_peered":"2024-05-09T12:20:20.634584+0000","last_unstale":"2024-05-09T12:29:54.934328+0000","last_undegraded":"2024-05-09T12:29:54.934328+0000","last_fullsized":"2024-05-09T12:29:54.934328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2406","last_scrub_stamp":"2024-05-09T12:29:50.485766+0000","last_deep_scrub":"35'2406","last_deep_scrub_stamp":"2024-05-09T12:29:50.485766+0000","last_clean_scrub_stamp":"2024-05-09T12:29:50.485766+0000","objects_scrubbed":6,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:53.505584+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2382,"num_write_kb":38028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707320,"num_omap_keys":1404,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"35'3124","reported_seq":2555,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508753+0000","last_change":"2024-05-09T12:29:47.540669+0000","last_active":"2024-05-09T12:29:55.508753+0000","last_peered":"2024-05-09T12:29:55.508753+0000","last_clean":"2024-05-09T12:29:55.508753+0000","last_became_active":"2024-05-09T12:20:21.633335+0000","last_became_peered":"2024-05-09T12:20:21.633335+0000","last_unstale":"2024-05-09T12:29:55.508753+0000","last_undegraded":"2024-05-09T12:29:55.508753+0000","last_fullsized":"2024-05-09T12:29:55.508753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3124","last_scrub_stamp":"2024-05-09T12:29:47.540510+0000","last_deep_scrub":"35'3124","last_deep_scrub_stamp":"2024-05-09T12:29:47.540510+0000","last_clean_scrub_stamp":"2024-05-09T12:29:47.540510+0000","objects_scrubbed":2,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:11:21.496216+0000","scrub_duration":7,"objects_trimmed":634,"snaptrim_duration":17.867235921999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'762","reported_seq":827,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.934465+0000","last_change":"2024-05-09T12:29:43.567649+0000","last_active":"2024-05-09T12:29:54.934465+0000","last_peered":"2024-05-09T12:29:54.934465+0000","last_clean":"2024-05-09T12:29:54.934465+0000","last_became_active":"2024-05-09T12:20:20.632479+0000","last_became_peered":"2024-05-09T12:20:20.632479+0000","last_unstale":"2024-05-09T12:29:54.934465+0000","last_undegraded":"2024-05-09T12:29:54.934465+0000","last_fullsized":"2024-05-09T12:29:54.934465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'762","last_scrub_stamp":"2024-05-09T12:29:43.567500+0000","last_deep_scrub":"32'762","last_deep_scrub_stamp":"2024-05-09T12:29:43.567500+0000","last_clean_scrub_stamp":"2024-05-09T12:29:43.567500+0000","objects_scrubbed":1,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:39:41.242684+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"35'3162","reported_seq":2580,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.512035+0000","last_change":"2024-05-09T12:29:54.525513+0000","last_active":"2024-05-09T12:29:55.512035+0000","last_peered":"2024-05-09T12:29:55.512035+0000","last_clean":"2024-05-09T12:29:55.512035+0000","last_became_active":"2024-05-09T12:20:21.638029+0000","last_became_peered":"2024-05-09T12:20:21.638029+0000","last_unstale":"2024-05-09T12:29:55.512035+0000","last_undegraded":"2024-05-09T12:29:55.512035+0000","last_fullsized":"2024-05-09T12:29:55.512035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3162","last_scrub_stamp":"2024-05-09T12:29:54.525428+0000","last_deep_scrub":"35'3162","last_deep_scrub_stamp":"2024-05-09T12:29:54.525428+0000","last_clean_scrub_stamp":"2024-05-09T12:29:54.525428+0000","objects_scrubbed":1,"log_size":3162,"log_dups_size":0,"ondisk_log_size":3162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:03:35.861183+0000","scrub_duration":3,"objects_trimmed":660,"snaptrim_duration":17.859630848999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"35'6251","reported_seq":6315,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.937997+0000","last_change":"2024-05-09T12:29:53.150170+0000","last_active":"2024-05-09T12:29:54.937997+0000","last_peered":"2024-05-09T12:29:54.937997+0000","last_clean":"2024-05-09T12:29:54.937997+0000","last_became_active":"2024-05-09T12:20:20.632472+0000","last_became_peered":"2024-05-09T12:20:20.632472+0000","last_unstale":"2024-05-09T12:29:54.937997+0000","last_undegraded":"2024-05-09T12:29:54.937997+0000","last_fullsized":"2024-05-09T12:29:54.937997+0000","mapping_epoch":14,"log_start":"19'300","ondisk_log_start":"19'300","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6251","last_scrub_stamp":"2024-05-09T12:29:53.150039+0000","last_deep_scrub":"35'6251","last_deep_scrub_stamp":"2024-05-09T12:29:53.150039+0000","last_clean_scrub_stamp":"2024-05-09T12:29:53.150039+0000","objects_scrubbed":4,"log_size":5951,"log_dups_size":0,"ondisk_log_size":5951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:04.478918+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6246,"num_write_kb":30596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2575,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"36'3597","reported_seq":2894,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:56.512153+0000","last_change":"2024-05-09T12:29:56.512179+0000","last_active":"2024-05-09T12:29:56.512153+0000","last_peered":"2024-05-09T12:29:56.512153+0000","last_clean":"2024-05-09T12:29:56.512153+0000","last_became_active":"2024-05-09T12:20:21.633931+0000","last_became_peered":"2024-05-09T12:20:21.633931+0000","last_unstale":"2024-05-09T12:29:56.512153+0000","last_undegraded":"2024-05-09T12:29:56.512153+0000","last_fullsized":"2024-05-09T12:29:56.512153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3597","last_scrub_stamp":"2024-05-09T12:29:56.512060+0000","last_deep_scrub":"36'3597","last_deep_scrub_stamp":"2024-05-09T12:29:56.512060+0000","last_clean_scrub_stamp":"2024-05-09T12:29:56.512060+0000","objects_scrubbed":1,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:32.952366+0000","scrub_duration":5,"objects_trimmed":780,"snaptrim_duration":15.325386052000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"34'3298","reported_seq":3362,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508477+0000","last_change":"2024-05-09T12:29:41.532018+0000","last_active":"2024-05-09T12:29:55.508477+0000","last_peered":"2024-05-09T12:29:55.508477+0000","last_clean":"2024-05-09T12:29:55.508477+0000","last_became_active":"2024-05-09T12:20:20.627266+0000","last_became_peered":"2024-05-09T12:20:20.627266+0000","last_unstale":"2024-05-09T12:29:55.508477+0000","last_undegraded":"2024-05-09T12:29:55.508477+0000","last_fullsized":"2024-05-09T12:29:55.508477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3298","last_scrub_stamp":"2024-05-09T12:29:41.531882+0000","last_deep_scrub":"34'3298","last_deep_scrub_stamp":"2024-05-09T12:29:41.531882+0000","last_clean_scrub_stamp":"2024-05-09T12:29:41.531882+0000","objects_scrubbed":3,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:42.799792+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":9331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"34'3149","reported_seq":2532,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:58.064522+0000","last_change":"2024-05-09T12:29:58.064549+0000","last_active":"2024-05-09T12:29:58.064522+0000","last_peered":"2024-05-09T12:29:58.064522+0000","last_clean":"2024-05-09T12:29:58.064522+0000","last_became_active":"2024-05-09T12:20:21.635925+0000","last_became_peered":"2024-05-09T12:20:21.635925+0000","last_unstale":"2024-05-09T12:29:58.064522+0000","last_undegraded":"2024-05-09T12:29:58.064522+0000","last_fullsized":"2024-05-09T12:29:58.064522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3149","last_scrub_stamp":"2024-05-09T12:29:58.064405+0000","last_deep_scrub":"34'3149","last_deep_scrub_stamp":"2024-05-09T12:29:58.064405+0000","last_clean_scrub_stamp":"2024-05-09T12:29:58.064405+0000","objects_scrubbed":0,"log_size":3149,"log_dups_size":0,"ondisk_log_size":3149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:10.393110+0000","scrub_duration":2,"objects_trimmed":717,"snaptrim_duration":15.179340623,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'627","reported_seq":691,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:54.936210+0000","last_change":"2024-05-09T12:29:44.120988+0000","last_active":"2024-05-09T12:29:54.936210+0000","last_peered":"2024-05-09T12:29:54.936210+0000","last_clean":"2024-05-09T12:29:54.936210+0000","last_became_active":"2024-05-09T12:20:20.631444+0000","last_became_peered":"2024-05-09T12:20:20.631444+0000","last_unstale":"2024-05-09T12:29:54.936210+0000","last_undegraded":"2024-05-09T12:29:54.936210+0000","last_fullsized":"2024-05-09T12:29:54.936210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'627","last_scrub_stamp":"2024-05-09T12:29:44.120861+0000","last_deep_scrub":"34'627","last_deep_scrub_stamp":"2024-05-09T12:29:44.120861+0000","last_clean_scrub_stamp":"2024-05-09T12:29:44.120861+0000","objects_scrubbed":1,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T22:37:42.345066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":634,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"36'3200","reported_seq":2582,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:04.141269+0000","last_change":"2024-05-09T12:30:04.141298+0000","last_active":"2024-05-09T12:30:04.141269+0000","last_peered":"2024-05-09T12:30:04.141269+0000","last_clean":"2024-05-09T12:30:04.141269+0000","last_became_active":"2024-05-09T12:20:21.642127+0000","last_became_peered":"2024-05-09T12:20:21.642127+0000","last_unstale":"2024-05-09T12:30:04.141269+0000","last_undegraded":"2024-05-09T12:30:04.141269+0000","last_fullsized":"2024-05-09T12:30:04.141269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3200","last_scrub_stamp":"2024-05-09T12:30:04.141193+0000","last_deep_scrub":"36'3200","last_deep_scrub_stamp":"2024-05-09T12:30:04.141193+0000","last_clean_scrub_stamp":"2024-05-09T12:30:04.141193+0000","objects_scrubbed":1,"log_size":3200,"log_dups_size":0,"ondisk_log_size":3200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:37.891044+0000","scrub_duration":4,"objects_trimmed":679,"snaptrim_duration":14.263989603000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1240,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'8186","reported_seq":8250,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:30:00.548218+0000","last_change":"2024-05-09T12:30:00.548279+0000","last_active":"2024-05-09T12:30:00.548218+0000","last_peered":"2024-05-09T12:30:00.548218+0000","last_clean":"2024-05-09T12:30:00.548218+0000","last_became_active":"2024-05-09T12:20:20.633964+0000","last_became_peered":"2024-05-09T12:20:20.633964+0000","last_unstale":"2024-05-09T12:30:00.548218+0000","last_undegraded":"2024-05-09T12:30:00.548218+0000","last_fullsized":"2024-05-09T12:30:00.548218+0000","mapping_epoch":14,"log_start":"19'2600","ondisk_log_start":"19'2600","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8186","last_scrub_stamp":"2024-05-09T12:30:00.548105+0000","last_deep_scrub":"36'8186","last_deep_scrub_stamp":"2024-05-09T12:30:00.548105+0000","last_clean_scrub_stamp":"2024-05-09T12:30:00.548105+0000","objects_scrubbed":5,"log_size":5586,"log_dups_size":0,"ondisk_log_size":5586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:50.419892+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8181,"num_write_kb":31532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'3075","reported_seq":2501,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508302+0000","last_change":"2024-05-09T12:29:49.495099+0000","last_active":"2024-05-09T12:29:55.508302+0000","last_peered":"2024-05-09T12:29:55.508302+0000","last_clean":"2024-05-09T12:29:55.508302+0000","last_became_active":"2024-05-09T12:20:21.633892+0000","last_became_peered":"2024-05-09T12:20:21.633892+0000","last_unstale":"2024-05-09T12:29:55.508302+0000","last_undegraded":"2024-05-09T12:29:55.508302+0000","last_fullsized":"2024-05-09T12:29:55.508302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3075","last_scrub_stamp":"2024-05-09T12:29:49.494974+0000","last_deep_scrub":"35'3075","last_deep_scrub_stamp":"2024-05-09T12:29:49.494974+0000","last_clean_scrub_stamp":"2024-05-09T12:29:49.494974+0000","objects_scrubbed":1,"log_size":3075,"log_dups_size":0,"ondisk_log_size":3075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:30.762555+0000","scrub_duration":3,"objects_trimmed":629,"snaptrim_duration":17.854617736000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'5556","reported_seq":5621,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.508914+0000","last_change":"2024-05-09T12:29:40.610218+0000","last_active":"2024-05-09T12:29:55.508914+0000","last_peered":"2024-05-09T12:29:55.508914+0000","last_clean":"2024-05-09T12:29:55.508914+0000","last_became_active":"2024-05-09T12:20:20.627241+0000","last_became_peered":"2024-05-09T12:20:20.627241+0000","last_unstale":"2024-05-09T12:29:55.508914+0000","last_undegraded":"2024-05-09T12:29:55.508914+0000","last_fullsized":"2024-05-09T12:29:55.508914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5556","last_scrub_stamp":"2024-05-09T12:29:40.609902+0000","last_deep_scrub":"34'5556","last_deep_scrub_stamp":"2024-05-09T12:29:40.609902+0000","last_clean_scrub_stamp":"2024-05-09T12:29:40.609902+0000","objects_scrubbed":4,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:16:19.019232+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5545,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'3783","reported_seq":3034,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:59.096515+0000","last_change":"2024-05-09T12:29:59.096515+0000","last_active":"2024-05-09T12:29:59.096515+0000","last_peered":"2024-05-09T12:29:59.096515+0000","last_clean":"2024-05-09T12:29:59.096515+0000","last_became_active":"2024-05-09T12:20:21.635910+0000","last_became_peered":"2024-05-09T12:20:21.635910+0000","last_unstale":"2024-05-09T12:29:59.096515+0000","last_undegraded":"2024-05-09T12:29:59.096515+0000","last_fullsized":"2024-05-09T12:29:59.096515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3783","last_scrub_stamp":"2024-05-09T12:29:59.096393+0000","last_deep_scrub":"36'3783","last_deep_scrub_stamp":"2024-05-09T12:29:59.096393+0000","last_clean_scrub_stamp":"2024-05-09T12:29:59.096393+0000","objects_scrubbed":4,"log_size":3783,"log_dups_size":0,"ondisk_log_size":3783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:37.344156+0000","scrub_duration":8,"objects_trimmed":799,"snaptrim_duration":14.263458647,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1364,"num_write_kb":726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2441","reported_seq":2506,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-09T12:29:55.509235+0000","last_change":"2024-05-09T12:29:45.567556+0000","last_active":"2024-05-09T12:29:55.509235+0000","last_peered":"2024-05-09T12:29:55.509235+0000","last_clean":"2024-05-09T12:29:55.509235+0000","last_became_active":"2024-05-09T12:20:20.631548+0000","last_became_peered":"2024-05-09T12:20:20.631548+0000","last_unstale":"2024-05-09T12:29:55.509235+0000","last_undegraded":"2024-05-09T12:29:55.509235+0000","last_fullsized":"2024-05-09T12:29:55.509235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2441","last_scrub_stamp":"2024-05-09T12:29:45.567415+0000","last_deep_scrub":"35'2441","last_deep_scrub_stamp":"2024-05-09T12:29:45.567415+0000","last_clean_scrub_stamp":"2024-05-09T12:29:45.567415+0000","objects_scrubbed":5,"log_size":2441,"log_dups_size":0,"ondisk_log_size":2441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:29.814234+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2445,"num_write_kb":15858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62238,"num_omap_keys":124,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127343,"num_objects":147,"num_object_clones":20,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":12,"num_read":45,"num_read_kb":31,"num_write":77508,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":254492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208885,"ondisk_log_size":208885,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":287136858,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":144,"num_read_kb":3170,"num_write":87026,"num_write_kb":575472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5655308,"num_omap_keys":11211,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":574341120,"data_stored":574273716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82458,"ondisk_log_size":82458,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705788,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":764744,"kb_used_data":115776,"kb_used_omap":1,"kb_used_meta":648958,"kb_avail":93607096,"statfs":{"total":96636764160,"available":95853666304,"internally_reserved":0,"allocated":118554624,"data_stored":118255999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":664533447},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705788,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969020,"kb_used_data":171508,"kb_used_omap":1,"kb_used_meta":797502,"kb_avail":93402820,"statfs":{"total":96636764160,"available":95644487680,"internally_reserved":0,"allocated":175624192,"data_stored":175337621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":816642501},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705790,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":588676,"kb_used_data":106364,"kb_used_omap":1,"kb_used_meta":482302,"kb_avail":93783164,"statfs":{"total":96636764160,"available":96033959936,"internally_reserved":0,"allocated":108916736,"data_stored":108617205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":493877701},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705790,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":827520,"kb_used_data":170296,"kb_used_omap":1,"kb_used_meta":657214,"kb_avail":93544320,"statfs":{"total":96636764160,"available":95789383680,"internally_reserved":0,"allocated":174383104,"data_stored":174080851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":672987589},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":173907968,"data_stored":173889922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107823104,"data_stored":107819514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":175144960,"data_stored":175122235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":117465088,"data_stored":117442045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":45246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":61640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":69703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":77903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T12:30:22.260 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T12:30:22.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.392+0000 7fb4d0813640 1 Processor -- start 2024-05-09T12:30:22.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.392+0000 7fb4d0813640 1 -- start start 2024-05-09T12:30:22.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.392+0000 7fb4d0813640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4cc13d7f0 0x7fb4cc13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.392+0000 7fb4d0813640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4d0813640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc09d4c0 con 0x7fb4cc09da60 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4d0813640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fb4cc09d2a0 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4d0813640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc09b180 con 0x7fb4cc140120 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.135:36458/0 (socket says 172.21.15.135:36458) 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 -- 172.21.15.135:0/2721448024 learned_addr learned my addr 172.21.15.135:0/2721448024 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4c9d9b640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4cc13d7f0 0x7fb4cc13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4ca59c640 1 --1- 172.21.15.135:0/2721448024 >> v1:172.21.15.160:6789/0 conn(0x7fb4cc09da60 0x7fb4cc09de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:41510/0 (socket says 172.21.15.135:41510) 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 -- 172.21.15.135:0/2721448024 >> v2:172.21.15.160:3300/0 conn(0x7fb4cc13d7f0 msgr2=0x7fb4cc13fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 --2- 172.21.15.135:0/2721448024 >> v2:172.21.15.160:3300/0 conn(0x7fb4cc13d7f0 0x7fb4cc13fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 -- 172.21.15.135:0/2721448024 >> v1:172.21.15.160:6789/0 conn(0x7fb4cc09da60 legacy=0x7fb4cc09de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.393+0000 7fb4cad9d640 1 -- 172.21.15.135:0/2721448024 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc09e820 con 0x7fb4cc140120 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.394+0000 7fb4cad9d640 1 --2- 172.21.15.135:0/2721448024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009e50 tx=0x7fb4c402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130c55ccd17a51c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.394+0000 7fb4c959a640 1 -- 172.21.15.135:0/2721448024 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c402c9e0 con 0x7fb4cc140120 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.394+0000 7fb4c959a640 1 -- 172.21.15.135:0/2721448024 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c402cb80 con 0x7fb4cc140120 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.394+0000 7fb4c959a640 1 -- 172.21.15.135:0/2721448024 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40343f0 con 0x7fb4cc140120 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 -- 172.21.15.135:0/2721448024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 msgr2=0x7fb4cc142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 --2- 172.21.15.135:0/2721448024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009e50 tx=0x7fb4c402be40 comp rx=0 tx=0).stop 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 -- 172.21.15.135:0/2721448024 shutdown_connections 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 --2- 172.21.15.135:0/2721448024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc142510 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 --2- 172.21.15.135:0/2721448024 >> v2:172.21.15.160:3300/0 conn(0x7fb4cc13d7f0 0x7fb4cc13fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 -- 172.21.15.135:0/2721448024 >> 172.21.15.135:0/2721448024 conn(0x7fb4cc075d90 msgr2=0x7fb4cc0aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 -- 172.21.15.135:0/2721448024 shutdown_connections 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.395+0000 7fb4d0813640 1 -- 172.21.15.135:0/2721448024 wait complete. 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.396+0000 7fb4d0813640 1 Processor -- start 2024-05-09T12:30:22.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.396+0000 7fb4d0813640 1 -- start start 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4cc09da60 0x7fb4cc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc09bf00 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc09d080 con 0x7fb4cc09da60 2024-05-09T12:30:22.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc09b8f0 con 0x7fb4cc140120 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44122/0 (socket says 172.21.15.135:44122) 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 -- 172.21.15.135:0/3077520189 learned_addr learned my addr 172.21.15.135:0/3077520189 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4ca59c640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4cc09da60 0x7fb4cc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4cad9d640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 -- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 msgr2=0x7fb4cc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 -- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4cc09da60 msgr2=0x7fb4cc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4cc09da60 0x7fb4cc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 -- 172.21.15.135:0/3077520189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc0a8a70 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4c9d9b640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000e980 tx=0x7fb4c000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0017070 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c000ca00 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc09ed70 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.397+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000cdd0 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.398+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc0a9010 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.398+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc06a680 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.400+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4c001a070 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.400+0000 7fb4baffd640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 0x7fb4ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.400+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7fb4c0097070 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.400+0000 7fb4ca59c640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 0x7fb4ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.400+0000 7fb4ca59c640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 0x7fb4ac078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc000f60 tx=0x7fb4bc000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.405+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4c0060880 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.591+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb4cc0508d0 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.594+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb4c0064b80 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.596+0000 7fb4baffd640 1 -- 172.21.15.135:0/3077520189 <== mon.0 v2:172.21.15.135:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb4c0060390 con 0x7fb4cc13d7f0 2024-05-09T12:30:22.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 msgr2=0x7fb4ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 0x7fb4ac078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc000f60 tx=0x7fb4bc000bc0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 msgr2=0x7fb4cc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000e980 tx=0x7fb4c000ee40 comp rx=0 tx=0).stop 2024-05-09T12:30:22.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 shutdown_connections 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb4ac0762d0 0x7fb4ac078790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4cc140120 0x7fb4cc06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4cc13d7f0 0x7fb4cc06d720 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 --2- 172.21.15.135:0/3077520189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4cc09da60 0x7fb4cc06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 >> 172.21.15.135:0/3077520189 conn(0x7fb4cc075d90 msgr2=0x7fb4cc13dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 shutdown_connections 2024-05-09T12:30:22.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.597+0000 7fb4d0813640 1 -- 172.21.15.135:0/3077520189 wait complete. 2024-05-09T12:30:22.609 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T12:30:22.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.708+0000 7faaaa377640 1 Processor -- start 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.708+0000 7faaaa377640 1 -- start start 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaaa377640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faaa41399f0 0x7faaa413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaaa377640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faaa413cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaaa377640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa4073d70 con 0x7faaa413d160 2024-05-09T12:30:22.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaaa377640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7faaa4073fe0 con 0x7faaa41399f0 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaaa377640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faaa4072820 con 0x7faaa4139dd0 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa8914640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faaa413d160 0x7faaa4143a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:44464/0 (socket says 172.21.15.135:44464) 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa8914640 1 -- 172.21.15.135:0/4218769679 learned_addr learned my addr 172.21.15.135:0/4218769679 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa3fff640 1 --2- 172.21.15.135:0/4218769679 >> v2:172.21.15.160:3300/0 conn(0x7faaa41399f0 0x7faaa413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa37fe640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faaa413cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106372745 0 0) 0x7faaa4073d70 con 0x7faaa413d160 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.709+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa90003520 con 0x7faaa413d160 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4287184076 0 0) 0x7faa90003520 con 0x7faaa413d160 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 msgr2=0x7faaa413cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faaa413cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 >> v2:172.21.15.160:3300/0 conn(0x7faaa41399f0 msgr2=0x7faaa413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 --2- 172.21.15.135:0/4218769679 >> v2:172.21.15.160:3300/0 conn(0x7faaa41399f0 0x7faaa413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa406d800 con 0x7faaa413d160 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2155055929 0 0) 0x7faa9c001a70 con 0x7faaa413d160 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 >> v1:172.21.15.135:6789/0 conn(0x7faaa413d160 legacy=0x7faaa4143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90003a00 0x7faa90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa90004800 0x7faa90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faa900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faaa4072820 con 0x7faa90004800 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faa9000b9c0 con 0x7faa90003a00 2024-05-09T12:30:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faa9000bbc0 con 0x7faaa4139dd0 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa90004800 0x7faa90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa3fff640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90003a00 0x7faa90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa8914640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faa900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 -- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 msgr2=0x7faa900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4139dd0 0x7faa900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 -- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90003a00 msgr2=0x7faa90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90003a00 0x7faa90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.710+0000 7faaa37fe640 1 -- 172.21.15.135:0/4218769679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa90003520 con 0x7faa90004800 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaa37fe640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa90004800 0x7faa90004c80 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009ac0 tx=0x7faa90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2e164c26bbf41f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c039070 con 0x7faa90004800 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa8c02c6b0 con 0x7faa90004800 2024-05-09T12:30:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaa2ffd640 1 -- 172.21.15.135:0/4218769679 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c009690 con 0x7faa90004800 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaaa377640 1 -- 172.21.15.135:0/4218769679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa90004800 msgr2=0x7faa90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaaa377640 1 --2- 172.21.15.135:0/4218769679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa90004800 0x7faa90004c80 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009ac0 tx=0x7faa90005830 comp rx=0 tx=0).stop 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.711+0000 7faaa8914640 1 -- 172.21.15.135:0/4218769679 reap_dead start 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.712+0000 7faaaa377640 1 -- 172.21.15.135:0/4218769679 shutdown_connections 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.712+0000 7faaaa377640 1 -- 172.21.15.135:0/4218769679 >> 172.21.15.135:0/4218769679 conn(0x7faaa4075cf0 msgr2=0x7faaa40aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.712+0000 7faaaa377640 1 -- 172.21.15.135:0/4218769679 shutdown_connections 2024-05-09T12:30:22.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.712+0000 7faaaa377640 1 -- 172.21.15.135:0/4218769679 wait complete. 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.712+0000 7faaaa377640 1 Processor -- start 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 -- start start 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90004800 0x7faaa4136700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4136c40 0x7faaa41d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faaa406eac0 con 0x7faaa41d21b0 2024-05-09T12:30:22.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faaa40a9cd0 con 0x7faa90004800 2024-05-09T12:30:22.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaaa377640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faaa4073430 con 0x7faaa4136c40 2024-05-09T12:30:22.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaa8914640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaa8914640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57416/0 (socket says 172.21.15.135:57416) 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaa8914640 1 -- 172.21.15.135:0/3317885036 learned_addr learned my addr 172.21.15.135:0/3317885036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaa3fff640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90004800 0x7faaa4136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.713+0000 7faaa37fe640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4136c40 0x7faaa41d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 -- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4136c40 msgr2=0x7faaa41d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4136c40 0x7faaa41d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 -- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90004800 msgr2=0x7faaa4136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90004800 0x7faaa4136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 -- 172.21.15.135:0/3317885036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa40a3a90 con 0x7faaa41d21b0 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa8914640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7faaa413d540 tx=0x7faa9c007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c017020 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa9c00ab20 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa40a4720 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0133f0 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.714+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa40a4c30 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.715+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa406d1e0 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.716+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa9c01a020 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.717+0000 7faaa0ff9640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 0x7faa840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.717+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7faa9c097be0 con 0x7faaa41d21b0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.717+0000 7faaa3fff640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 0x7faa840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.717+0000 7faaa3fff640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 0x7faa840787c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa94009bc0 tx=0x7faa94009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:22.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.720+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faaa406d1e0 con 0x7faaa41d21b0 2024-05-09T12:30:22.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.942+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa40508d0 con 0x7faaa41d21b0 2024-05-09T12:30:22.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.943+0000 7faaa0ff9640 1 -- 172.21.15.135:0/3317885036 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7faa9c021020 con 0x7faaa41d21b0 2024-05-09T12:30:22.943 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:30:22.944 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:30:22.944 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:30:22.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 msgr2=0x7faa840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 0x7faa840787c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa94009bc0 tx=0x7faa94009190 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 msgr2=0x7faaa41d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7faaa413d540 tx=0x7faa9c007b10 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 shutdown_connections 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7faa84076300 0x7faa840787c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaa41d21b0 0x7faaa41d2660 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaa4136c40 0x7faaa41d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 --2- 172.21.15.135:0/3317885036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa90004800 0x7faaa4136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 >> 172.21.15.135:0/3317885036 conn(0x7faaa4075cf0 msgr2=0x7faaa413ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:22.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 shutdown_connections 2024-05-09T12:30:22.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:22.945+0000 7faaaa377640 1 -- 172.21.15.135:0/3317885036 wait complete. 2024-05-09T12:30:22.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T12:30:23.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.057+0000 7fa13a8e7640 1 Processor -- start 2024-05-09T12:30:23.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.057+0000 7fa13a8e7640 1 -- start start 2024-05-09T12:30:23.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 0x7fa13413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa13406d1e0 0x7fa13406d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13406db90 0x7fa134143a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa134073310 con 0x7fa13406d1e0 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fa13413c750 con 0x7fa13413cdc0 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa13a8e7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa134073be0 con 0x7fa13406db90 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa13406d1e0 0x7fa13406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa13406d1e0 0x7fa13406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57432/0 (socket says 172.21.15.135:57432) 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 -- 172.21.15.135:0/1050116020 learned_addr learned my addr 172.21.15.135:0/1050116020 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:23.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa133fff640 1 --2- 172.21.15.135:0/1050116020 >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 0x7fa13413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa138e84640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13406db90 0x7fa134143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 -- 172.21.15.135:0/1050116020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13406db90 msgr2=0x7fa134143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13406db90 0x7fa134143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 -- 172.21.15.135:0/1050116020 >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 msgr2=0x7fa13413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 --2- 172.21.15.135:0/1050116020 >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 0x7fa13413d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa1337fe640 1 -- 172.21.15.135:0/1050116020 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13406e000 con 0x7fa13406d1e0 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.058+0000 7fa133fff640 1 --2- 172.21.15.135:0/1050116020 >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 0x7fa13413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:30:23.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.059+0000 7fa1337fe640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa13406d650 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa13406ebc0 tx=0x7fa11c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35badf57284ece8f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.059+0000 7fa132ffd640 1 -- 172.21.15.135:0/1050116020 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c038070 con 0x7fa13406d1e0 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.059+0000 7fa132ffd640 1 -- 172.21.15.135:0/1050116020 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa11c02f050 con 0x7fa13406d1e0 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.059+0000 7fa132ffd640 1 -- 172.21.15.135:0/1050116020 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c031990 con 0x7fa13406d1e0 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 -- 172.21.15.135:0/1050116020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 msgr2=0x7fa13406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa13406d650 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa13406ebc0 tx=0x7fa11c02b7f0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 -- 172.21.15.135:0/1050116020 shutdown_connections 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13406db90 0x7fa134143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/1050116020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa13406d650 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/1050116020 >> v2:172.21.15.160:3300/0 conn(0x7fa13413cdc0 0x7fa13413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 -- 172.21.15.135:0/1050116020 >> 172.21.15.135:0/1050116020 conn(0x7fa134075d60 msgr2=0x7fa1340acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 -- 172.21.15.135:0/1050116020 shutdown_connections 2024-05-09T12:30:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.060+0000 7fa13a8e7640 1 -- 172.21.15.135:0/1050116020 wait complete. 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.061+0000 7fa13a8e7640 1 Processor -- start 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.061+0000 7fa13a8e7640 1 -- start start 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13406db90 0x7fa134139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13413cdc0 0x7fa1341d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa13406e590 con 0x7fa13406d1e0 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa134073530 con 0x7fa13406db90 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa13a8e7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1340a9c50 con 0x7fa13413cdc0 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57434/0 (socket says 172.21.15.135:57434) 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 -- 172.21.15.135:0/2363593572 learned_addr learned my addr 172.21.15.135:0/2363593572 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:23.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa1337fe640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13406db90 0x7fa134139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa138e84640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13413cdc0 0x7fa1341d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 -- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13413cdc0 msgr2=0x7fa1341d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13413cdc0 0x7fa1341d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 -- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13406db90 msgr2=0x7fa134139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13406db90 0x7fa134139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.062+0000 7fa133fff640 1 -- 172.21.15.135:0/2363593572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1340a93f0 con 0x7fa13406d1e0 2024-05-09T12:30:23.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa133fff640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d7d0 tx=0x7fa12400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124004030 con 0x7fa13406d1e0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa1240041d0 con 0x7fa13406d1e0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1340a7d20 con 0x7fa13406d1e0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12400b6c0 con 0x7fa13406d1e0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.063+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1340a7fe0 con 0x7fa13406d1e0 2024-05-09T12:30:23.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.064+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1340508d0 con 0x7fa13406d1e0 2024-05-09T12:30:23.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.064+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa12400b860 con 0x7fa13406d1e0 2024-05-09T12:30:23.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.065+0000 7fa130ff9640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 0x7fa114078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.065+0000 7fa1337fe640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 0x7fa114078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.065+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7fa124097370 con 0x7fa13406d1e0 2024-05-09T12:30:23.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.065+0000 7fa1337fe640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 0x7fa114078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa11c035000 tx=0x7fa11c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.069+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1240611c0 con 0x7fa13406d1e0 2024-05-09T12:30:23.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.293+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa13406ee90 con 0x7fa13406d1e0 2024-05-09T12:30:23.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.294+0000 7fa130ff9640 1 -- 172.21.15.135:0/2363593572 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3533 (secure 0 0 0) 0x7fa124097030 con 0x7fa13406d1e0 2024-05-09T12:30:23.295 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:30:23.295 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4199,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6817/2132160981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2132160981},{"type":"v1","addr":"172.21.15.160:6817","nonce":2132160981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T12:20:20.983047+0000","modified":"2024-05-09T12:20:22.975757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4215":{"gid":4215,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.135:6819/2919634794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2919634794},{"type":"v1","addr":"172.21.15.135:6819","nonce":2919634794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4215,"qdb_cluster":[4215]},"id":1}]} 2024-05-09T12:30:23.295 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-05-09T12:30:23.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 msgr2=0x7fa114078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 0x7fa114078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa11c035000 tx=0x7fa11c008030 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 msgr2=0x7fa134139610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d7d0 tx=0x7fa12400dc90 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 shutdown_connections 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fa1140762d0 0x7fa114078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa13413cdc0 0x7fa1341d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13406db90 0x7fa134139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 --2- 172.21.15.135:0/2363593572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa13406d1e0 0x7fa134139610 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 >> 172.21.15.135:0/2363593572 conn(0x7fa134075d60 msgr2=0x7fa1341c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 shutdown_connections 2024-05-09T12:30:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.296+0000 7fa13a8e7640 1 -- 172.21.15.135:0/2363593572 wait complete. 2024-05-09T12:30:23.308 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T12:30:23.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.406+0000 7ff220b2d640 1 Processor -- start 2024-05-09T12:30:23.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.406+0000 7ff220b2d640 1 -- start start 2024-05-09T12:30:23.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff220b2d640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff21c13d960 0x7ff21c13fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff220b2d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff21c140290 0x7ff21c142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff220b2d640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21c09bbf0 con 0x7ff21c137510 2024-05-09T12:30:23.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff220b2d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff21c09b9d0 con 0x7ff21c140290 2024-05-09T12:30:23.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff220b2d640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7ff21c074320 con 0x7ff21c13d960 2024-05-09T12:30:23.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff21c140290 0x7ff21c142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff21c140290 0x7ff21c142680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57438/0 (socket says 172.21.15.135:57438) 2024-05-09T12:30:23.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 -- 172.21.15.135:0/4233829230 learned_addr learned my addr 172.21.15.135:0/4233829230 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 -- 172.21.15.135:0/4233829230 >> v2:172.21.15.160:3300/0 conn(0x7ff21c13d960 msgr2=0x7ff21c13fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 --2- 172.21.15.135:0/4233829230 >> v2:172.21.15.160:3300/0 conn(0x7ff21c13d960 0x7ff21c13fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 -- 172.21.15.135:0/4233829230 >> v1:172.21.15.160:6789/0 conn(0x7ff21c137510 legacy=0x7ff21c1378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.407+0000 7ff21ad9d640 1 -- 172.21.15.135:0/4233829230 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c09b260 con 0x7ff21c140290 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.408+0000 7ff21ad9d640 1 --2- 172.21.15.135:0/4233829230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c142680 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0746e0 tx=0x7ff21402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819fadea2e2a9c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.408+0000 7ff21959a640 1 -- 172.21.15.135:0/4233829230 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21402c950 con 0x7ff21c140290 2024-05-09T12:30:23.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.408+0000 7ff21959a640 1 -- 172.21.15.135:0/4233829230 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff21402caf0 con 0x7ff21c140290 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.408+0000 7ff21959a640 1 -- 172.21.15.135:0/4233829230 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2140343f0 con 0x7ff21c140290 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.408+0000 7ff220b2d640 1 -- 172.21.15.135:0/4233829230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 msgr2=0x7ff21c142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 --2- 172.21.15.135:0/4233829230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c142680 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0746e0 tx=0x7ff21402bdb0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 -- 172.21.15.135:0/4233829230 shutdown_connections 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 --2- 172.21.15.135:0/4233829230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c142680 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 --2- 172.21.15.135:0/4233829230 >> v2:172.21.15.160:3300/0 conn(0x7ff21c13d960 0x7ff21c13fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 -- 172.21.15.135:0/4233829230 >> 172.21.15.135:0/4233829230 conn(0x7ff21c075e50 msgr2=0x7ff21c0aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 -- 172.21.15.135:0/4233829230 shutdown_connections 2024-05-09T12:30:23.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.409+0000 7ff220b2d640 1 -- 172.21.15.135:0/4233829230 wait complete. 2024-05-09T12:30:23.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 Processor -- start 2024-05-09T12:30:23.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 -- start start 2024-05-09T12:30:23.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff21c137510 0x7ff21c1cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 0x7ff21c1cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c09e8f0 con 0x7ff21c140290 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c09bfe0 con 0x7ff21c137510 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff220b2d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff21c09b6b0 con 0x7ff21c13d960 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff21ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff21ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57452/0 (socket says 172.21.15.135:57452) 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.410+0000 7ff21ad9d640 1 -- 172.21.15.135:0/924444789 learned_addr learned my addr 172.21.15.135:0/924444789 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21a59c640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff21c137510 0x7ff21c1cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff219d9b640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 0x7ff21c1cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 -- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 msgr2=0x7ff21c1cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 0x7ff21c1cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 -- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff21c137510 msgr2=0x7ff21c1cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff21c137510 0x7ff21c1cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 -- 172.21.15.135:0/924444789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c0a3f80 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff219d9b640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 0x7ff21c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff21ad9d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff214036040 tx=0x7ff214004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214043020 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff21403e450 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21c1cc670 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21403e860 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.411+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21c0a3970 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.412+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21c0508d0 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.413+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff214046020 con 0x7ff21c140290 2024-05-09T12:30:23.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.413+0000 7ff20affd640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 0x7ff1fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.413+0000 7ff21a59c640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 0x7ff1fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.413+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7ff2140b9840 con 0x7ff21c140290 2024-05-09T12:30:23.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.413+0000 7ff21a59c640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 0x7ff1fc0787c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff20c007fd0 tx=0x7ff20c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.417+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff21404d070 con 0x7ff21c140290 2024-05-09T12:30:23.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.606+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff21c0a3b40 con 0x7ff21c140290 2024-05-09T12:30:23.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.607+0000 7ff20affd640 1 -- 172.21.15.135:0/924444789 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13758 (secure 0 0 0) 0x7ff214083690 con 0x7ff21c140290 2024-05-09T12:30:23.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:30:23.607 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":36,"fsid":"c87e53f9-e7b2-4007-9931-7931693416e8","created":"2024-05-09T12:20:05.065364+0000","modified":"2024-05-09T12:29:54.929057+0000","last_up_change":"2024-05-09T12:20:13.567845+0000","last_in_change":"2024-05-09T12:20:06.169041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-05-09T12:20:13.958403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-05-09T12:20:15.387931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-05-09T12:20:18.898888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-05-09T12:20:19.931761+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":51,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5341ef1f-315c-46db-b1b7-80aceff3242c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6801","nonce":3069336338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6803","nonce":3069336338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6807","nonce":3069336338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3069336338},{"type":"v1","addr":"172.21.15.135:6805","nonce":3069336338}]},"public_addr":"172.21.15.135:6801/3069336338","cluster_addr":"172.21.15.135:6803/3069336338","heartbeat_back_addr":"172.21.15.135:6807/3069336338","heartbeat_front_addr":"172.21.15.135:6805/3069336338","state":["exists","up"]},{"osd":1,"uuid":"e7b8ff2b-9353-4c4b-b32b-e8efb613bc3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6809","nonce":290955535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6811","nonce":290955535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6815","nonce":290955535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":290955535},{"type":"v1","addr":"172.21.15.135:6813","nonce":290955535}]},"public_addr":"172.21.15.135:6809/290955535","cluster_addr":"172.21.15.135:6811/290955535","heartbeat_back_addr":"172.21.15.135:6815/290955535","heartbeat_front_addr":"172.21.15.135:6813/290955535","state":["exists","up"]},{"osd":2,"uuid":"664ff7e7-89aa-4166-9a00-02a74c0e4e34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6801","nonce":2987975206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6803","nonce":2987975206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6807","nonce":2987975206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2987975206},{"type":"v1","addr":"172.21.15.160:6805","nonce":2987975206}]},"public_addr":"172.21.15.160:6801/2987975206","cluster_addr":"172.21.15.160:6803/2987975206","heartbeat_back_addr":"172.21.15.160:6807/2987975206","heartbeat_front_addr":"172.21.15.160:6805/2987975206","state":["exists","up"]},{"osd":3,"uuid":"5e48a560-dd8a-4ac1-8bb4-7bf36f5946a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6809","nonce":2030310005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6811","nonce":2030310005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6815","nonce":2030310005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":2030310005},{"type":"v1","addr":"172.21.15.160:6813","nonce":2030310005}]},"public_addr":"172.21.15.160:6809/2030310005","cluster_addr":"172.21.15.160:6811/2030310005","heartbeat_back_addr":"172.21.15.160:6815/2030310005","heartbeat_front_addr":"172.21.15.160:6813/2030310005","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.331732+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.357853+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.241728+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T12:20:11.343221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:0/1749211825":"2024-05-09T13:24:06.124315+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":49,"length":3}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 msgr2=0x7ff1fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 0x7ff1fc0787c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff20c007fd0 tx=0x7ff20c009040 comp rx=0 tx=0).stop 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 msgr2=0x7ff21c1d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff214036040 tx=0x7ff214004a40 comp rx=0 tx=0).stop 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 shutdown_connections 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7ff1fc076300 0x7ff1fc0787c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c140290 0x7ff21c1d0010 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff21c13d960 0x7ff21c1cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 --2- 172.21.15.135:0/924444789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff21c137510 0x7ff21c1cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 >> 172.21.15.135:0/924444789 conn(0x7ff21c075e50 msgr2=0x7ff21c1363c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 shutdown_connections 2024-05-09T12:30:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.609+0000 7ff220b2d640 1 -- 172.21.15.135:0/924444789 wait complete. 2024-05-09T12:30:23.621 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T12:30:23.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 Processor -- start 2024-05-09T12:30:23.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 -- start start 2024-05-09T12:30:23.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 0x7f3f5013cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 0x7f3f501393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f500a0390 con 0x7f3f50139930 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7f3f500a9f40 con 0x7f3f50074840 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.721+0000 7f3f57d49640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3f500a0710 con 0x7f3f5013d340 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f552e4640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 0x7f3f501393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f55ae5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 0x7f3f5013cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f562e6640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3f50139930 0x7f3f50143cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.135:53386/0 (socket says 172.21.15.135:53386) 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f562e6640 1 -- 172.21.15.135:0/3981114956 learned_addr learned my addr 172.21.15.135:0/3981114956 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f55ae5640 1 -- 172.21.15.135:0/3981114956 >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 msgr2=0x7f3f501393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f55ae5640 1 --2- 172.21.15.135:0/3981114956 >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 0x7f3f501393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f55ae5640 1 -- 172.21.15.135:0/3981114956 >> v1:172.21.15.160:6789/0 conn(0x7f3f50139930 legacy=0x7f3f50143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f55ae5640 1 -- 172.21.15.135:0/3981114956 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f50073e10 con 0x7f3f5013d340 2024-05-09T12:30:23.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.722+0000 7f3f552e4640 1 --2- 172.21.15.135:0/3981114956 >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 0x7f3f501393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:30:23.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f55ae5640 1 --2- 172.21.15.135:0/3981114956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 0x7f3f5013cbd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c590f9424f86d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f54ae3640 1 -- 172.21.15.135:0/3981114956 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c038070 con 0x7f3f5013d340 2024-05-09T12:30:23.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f54ae3640 1 -- 172.21.15.135:0/3981114956 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3f4c031700 con 0x7f3f5013d340 2024-05-09T12:30:23.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f54ae3640 1 -- 172.21.15.135:0/3981114956 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031af0 con 0x7f3f5013d340 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 -- 172.21.15.135:0/3981114956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 msgr2=0x7f3f5013cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 --2- 172.21.15.135:0/3981114956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 0x7f3f5013cbd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b7a0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 -- 172.21.15.135:0/3981114956 shutdown_connections 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 --2- 172.21.15.135:0/3981114956 >> v2:172.21.15.160:3300/0 conn(0x7f3f50074840 0x7f3f501393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 --2- 172.21.15.135:0/3981114956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f5013d340 0x7f3f5013cbd0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.723+0000 7f3f57d49640 1 -- 172.21.15.135:0/3981114956 >> 172.21.15.135:0/3981114956 conn(0x7f3f500ac8c0 msgr2=0x7f3f500accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.724+0000 7f3f57d49640 1 -- 172.21.15.135:0/3981114956 shutdown_connections 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.724+0000 7f3f57d49640 1 -- 172.21.15.135:0/3981114956 wait complete. 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.724+0000 7f3f57d49640 1 Processor -- start 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.724+0000 7f3f57d49640 1 -- start start 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f50074840 0x7f3f501d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 0x7f3f501d2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f500731e0 con 0x7f3f5013d340 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f500740d0 con 0x7f3f50139930 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f57d49640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5013d720 con 0x7f3f50074840 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f552e4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 0x7f3f501d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f55ae5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f50074840 0x7f3f501d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57460/0 (socket says 172.21.15.135:57460) 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 -- 172.21.15.135:0/4249876481 learned_addr learned my addr 172.21.15.135:0/4249876481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 -- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f50074840 msgr2=0x7f3f501d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f50074840 0x7f3f501d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 -- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 msgr2=0x7f3f501d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 0x7f3f501d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f562e6640 1 -- 172.21.15.135:0/4249876481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f500a45e0 con 0x7f3f5013d340 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.725+0000 7f3f552e4640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 0x7f3f501d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f562e6640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800cb50 tx=0x7f3f4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48017070 con 0x7f3f5013d340 2024-05-09T12:30:23.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3f4800ad40 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f500a5b00 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48012600 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.726+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f500a4980 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.727+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f500508d0 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.728+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f4801a070 con 0x7f3f5013d340 2024-05-09T12:30:23.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.728+0000 7f3f467fc640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 0x7f3f34078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.728+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4434+0+0 (secure 0 0 0) 0x7f3f48096d80 con 0x7f3f5013d340 2024-05-09T12:30:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.728+0000 7f3f55ae5640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 0x7f3f34078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.729+0000 7f3f55ae5640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 0x7f3f34078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c035000 tx=0x7f3f4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.733+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f500a45e0 con 0x7f3f5013d340 2024-05-09T12:30:23.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.957+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3f50072880 con 0x7f3f5013d340 2024-05-09T12:30:23.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.959+0000 7f3f467fc640 1 -- 172.21.15.135:0/4249876481 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f3f500a0390 con 0x7f3f5013d340 2024-05-09T12:30:23.960 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T12:30:23.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 msgr2=0x7f3f34078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 0x7f3f34078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c035000 tx=0x7f3f4c008030 comp rx=0 tx=0).stop 2024-05-09T12:30:23.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 msgr2=0x7f3f501d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800cb50 tx=0x7f3f4800a430 comp rx=0 tx=0).stop 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 shutdown_connections 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7f3f340762d0 0x7f3f34078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f5013d340 0x7f3f501d2b40 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f50139930 0x7f3f501d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 --2- 172.21.15.135:0/4249876481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f50074840 0x7f3f501d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 >> 172.21.15.135:0/4249876481 conn(0x7f3f500ac8c0 msgr2=0x7f3f501c2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 shutdown_connections 2024-05-09T12:30:23.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:23.964+0000 7f3f57d49640 1 -- 172.21.15.135:0/4249876481 wait complete. 2024-05-09T12:30:23.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T12:30:24.013 INFO:tasks.ceph.mds.a.smithi135.stdout:starting mds.a at 2024-05-09T12:30:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.083+0000 7fea5730e640 1 Processor -- start 2024-05-09T12:30:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 -- start start 2024-05-09T12:30:24.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea5013c700 0x7fea5013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fea5013f030 0x7fea50141420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea500715b0 con 0x7fea50073600 2024-05-09T12:30:24.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fea50071860 con 0x7fea5013f030 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.084+0000 7fea5730e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fea50070a20 con 0x7fea5013c700 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fea5013f030 0x7fea50141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fea5013f030 0x7fea50141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57482/0 (socket says 172.21.15.135:57482) 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 -- 172.21.15.135:0/2991780776 learned_addr learned my addr 172.21.15.135:0/2991780776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea548a9640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea5013c700 0x7fea5013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 -- 172.21.15.135:0/2991780776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea5013c700 msgr2=0x7fea5013eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea5013c700 0x7fea5013eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 -- 172.21.15.135:0/2991780776 >> v1:172.21.15.160:6789/0 conn(0x7fea50073600 legacy=0x7fea500739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.085+0000 7fea558ab640 1 -- 172.21.15.135:0/2991780776 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea500740f0 con 0x7fea5013f030 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.086+0000 7fea558ab640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50141420 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d180 tx=0x7fea4c02e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb69e7a95e32f0c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.086+0000 7fea47fff640 1 -- 172.21.15.135:0/2991780776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c02e9d0 con 0x7fea5013f030 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.086+0000 7fea47fff640 1 -- 172.21.15.135:0/2991780776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea4c02eb70 con 0x7fea5013f030 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.086+0000 7fea47fff640 1 -- 172.21.15.135:0/2991780776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c009600 con 0x7fea5013f030 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 -- 172.21.15.135:0/2991780776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 msgr2=0x7fea50141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50141420 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00d180 tx=0x7fea4c02e030 comp rx=0 tx=0).stop 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 -- 172.21.15.135:0/2991780776 shutdown_connections 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50141420 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 --2- 172.21.15.135:0/2991780776 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea5013c700 0x7fea5013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 -- 172.21.15.135:0/2991780776 >> 172.21.15.135:0/2991780776 conn(0x7fea500ab940 msgr2=0x7fea500abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 -- 172.21.15.135:0/2991780776 shutdown_connections 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.087+0000 7fea5730e640 1 -- 172.21.15.135:0/2991780776 wait complete. 2024-05-09T12:30:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 Processor -- start 2024-05-09T12:30:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 -- start start 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 0x7fea50138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea5013c700 0x7fea501386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea500729e0 con 0x7fea5013f030 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fea50071250 con 0x7fea5013c700 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea5730e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fea50070e50 con 0x7fea50073600 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57490/0 (socket says 172.21.15.135:57490) 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 -- 172.21.15.135:0/1878464059 learned_addr learned my addr 172.21.15.135:0/1878464059 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea548a9640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea5013c700 0x7fea501386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea550aa640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 0x7fea50138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 -- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 msgr2=0x7fea50138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 0x7fea50138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 -- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea5013c700 msgr2=0x7fea501386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.088+0000 7fea558ab640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea5013c700 0x7fea501386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea558ab640 1 -- 172.21.15.135:0/1878464059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5013bb50 con 0x7fea5013f030 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea550aa640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 0x7fea50138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea558ab640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fea4c02e070 tx=0x7fea4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c044030 con 0x7fea5013f030 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea4c03f440 con 0x7fea5013f030 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea500a4150 con 0x7fea5013f030 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00b720 con 0x7fea5013f030 2024-05-09T12:30:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.089+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea500a3d00 con 0x7fea5013f030 2024-05-09T12:30:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.090+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea50139ea0 con 0x7fea5013f030 2024-05-09T12:30:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.091+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea4c047070 con 0x7fea5013f030 2024-05-09T12:30:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.091+0000 7fea45ffb640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 0x7fea34078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.092+0000 7fea550aa640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 0x7fea34078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:24.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.092+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4492+0+0 (secure 0 0 0) 0x7fea4c0b9900 con 0x7fea5013f030 2024-05-09T12:30:24.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.092+0000 7fea550aa640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 0x7fea34078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea48007fd0 tx=0x7fea48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.096+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea4c04e070 con 0x7fea5013f030 2024-05-09T12:30:24.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.315+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea5009df20 con 0x7fea5013f030 2024-05-09T12:30:24.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.961+0000 7fea45ffb640 1 -- 172.21.15.135:0/1878464059 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7fea4c0837b0 con 0x7fea5013f030 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 msgr2=0x7fea34078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 0x7fea34078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea48007fd0 tx=0x7fea48009040 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 msgr2=0x7fea50138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fea4c02e070 tx=0x7fea4c004a40 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 shutdown_connections 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fea340762d0 0x7fea34078790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea5013f030 0x7fea50138c00 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea5013c700 0x7fea501386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 --2- 172.21.15.135:0/1878464059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea50073600 0x7fea50138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 >> 172.21.15.135:0/1878464059 conn(0x7fea500ab940 msgr2=0x7fea50134220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:24.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 shutdown_connections 2024-05-09T12:30:24.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:24.963+0000 7fea5730e640 1 -- 172.21.15.135:0/1878464059 wait complete. 2024-05-09T12:30:24.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T12:30:25.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.120+0000 7fcfb72e6640 1 Processor -- start 2024-05-09T12:30:25.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.120+0000 7fcfb72e6640 1 -- start start 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfb0074490 0x7fcfb006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcfb006e960 0x7fcfb013c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb013cc90 0x7fcfb013d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb0139730 con 0x7fcfb0074490 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb00739d0 con 0x7fcfb006e960 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb72e6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb0139950 con 0x7fcfb013cc90 2024-05-09T12:30:25.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfb0074490 0x7fcfb006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcfb0074490 0x7fcfb006e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57504/0 (socket says 172.21.15.135:57504) 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 -- 172.21.15.135:0/3964177975 learned_addr learned my addr 172.21.15.135:0/3964177975 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5883640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb013cc90 0x7fcfb013d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb4881640 1 --2- 172.21.15.135:0/3964177975 >> v2:172.21.15.160:3300/0 conn(0x7fcfb006e960 0x7fcfb013c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 -- 172.21.15.135:0/3964177975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb013cc90 msgr2=0x7fcfb013d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb013cc90 0x7fcfb013d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 -- 172.21.15.135:0/3964177975 >> v2:172.21.15.160:3300/0 conn(0x7fcfb006e960 msgr2=0x7fcfb013c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 --2- 172.21.15.135:0/3964177975 >> v2:172.21.15.160:3300/0 conn(0x7fcfb006e960 0x7fcfb013c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.121+0000 7fcfb5082640 1 -- 172.21.15.135:0/3964177975 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0074870 con 0x7fcfb0074490 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.122+0000 7fcfb5082640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb006e420 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00ad9b0 tx=0x7fcfac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b022937f9b7ba337 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.122+0000 7fcfa7fff640 1 -- 172.21.15.135:0/3964177975 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac02e070 con 0x7fcfb0074490 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.122+0000 7fcfa7fff640 1 -- 172.21.15.135:0/3964177975 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcfac037070 con 0x7fcfb0074490 2024-05-09T12:30:25.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.122+0000 7fcfa7fff640 1 -- 172.21.15.135:0/3964177975 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac031a20 con 0x7fcfb0074490 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 -- 172.21.15.135:0/3964177975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 msgr2=0x7fcfb006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb006e420 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00ad9b0 tx=0x7fcfac02b880 comp rx=0 tx=0).stop 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 -- 172.21.15.135:0/3964177975 shutdown_connections 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb013cc90 0x7fcfb013d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/3964177975 >> v2:172.21.15.160:3300/0 conn(0x7fcfb006e960 0x7fcfb013c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/3964177975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb006e420 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 -- 172.21.15.135:0/3964177975 >> 172.21.15.135:0/3964177975 conn(0x7fcfb0075d60 msgr2=0x7fcfb00aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 -- 172.21.15.135:0/3964177975 shutdown_connections 2024-05-09T12:30:25.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.123+0000 7fcfb72e6640 1 -- 172.21.15.135:0/3964177975 wait complete. 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 Processor -- start 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 -- start start 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 0x7fcfb0138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 0x7fcfb01d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00a9d10 con 0x7fcfb0074490 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0073c90 con 0x7fcfb013cc90 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb72e6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb0072820 con 0x7fcfb006e960 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57518/0 (socket says 172.21.15.135:57518) 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 -- 172.21.15.135:0/2181646006 learned_addr learned my addr 172.21.15.135:0/2181646006 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb5883640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 0x7fcfb01d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb5082640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 0x7fcfb0138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 -- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 msgr2=0x7fcfb0138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 0x7fcfb0138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 -- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 msgr2=0x7fcfb01d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 0x7fcfb01d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb4881640 1 -- 172.21.15.135:0/2181646006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb00a7ab0 con 0x7fcfb0074490 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb5883640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 0x7fcfb01d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:30:25.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.124+0000 7fcfb5082640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 0x7fcfb0138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfb4881640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000d5f0 tx=0x7fcfa000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00125f0 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcfa0019070 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb00a5990 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00129f0 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.125+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb00a6660 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.126+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb00aa320 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.126+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfa0012b90 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.127+0000 7fcfa5ffb640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 0x7fcf94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.127+0000 7fcfb5082640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 0x7fcf94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.127+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4492+0+0 (secure 0 0 0) 0x7fcfa0097630 con 0x7fcfb0074490 2024-05-09T12:30:25.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.127+0000 7fcfb5082640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 0x7fcf94078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfac036000 tx=0x7fcfac03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:25.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.131+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfb00aa320 con 0x7fcfb0074490 2024-05-09T12:30:25.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.317+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcfb0069a50 con 0x7fcfb0074490 2024-05-09T12:30:25.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.964+0000 7fcfa5ffb640 1 -- 172.21.15.135:0/2181646006 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) ==== 181+0+0 (secure 0 0 0) 0x7fcfa00613c0 con 0x7fcfb0074490 2024-05-09T12:30:25.966 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-05-09T12:30:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 msgr2=0x7fcf94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 0x7fcf94078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfac036000 tx=0x7fcfac03d040 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 msgr2=0x7fcfb0138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000d5f0 tx=0x7fcfa000dab0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 shutdown_connections 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fcf940762d0 0x7fcf94078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb013cc90 0x7fcfb01d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb0074490 0x7fcfb0138a60 secure :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000d5f0 tx=0x7fcfa000dab0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 --2- 172.21.15.135:0/2181646006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb006e960 0x7fcfb0138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 >> 172.21.15.135:0/2181646006 conn(0x7fcfb0075d60 msgr2=0x7fcfb01c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.969+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 shutdown_connections 2024-05-09T12:30:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:25.970+0000 7fcfb72e6640 1 -- 172.21.15.135:0/2181646006 wait complete. 2024-05-09T12:30:25.986 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T12:30:26.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.095+0000 7fba17d6a640 1 Processor -- start 2024-05-09T12:30:26.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.095+0000 7fba17d6a640 1 -- start start 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fba1006d830 0x7fba1006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 0x7fba1013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba10143b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fba10073cb0 con 0x7fba1006d830 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 -- 0x7fba10073960 con 0x7fba1013a6c0 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba17d6a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba1006e5d0 con 0x7fba1013b090 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fba1006d830 0x7fba1006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fba1006d830 0x7fba1006dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57522/0 (socket says 172.21.15.135:57522) 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 -- 172.21.15.135:0/1260719681 learned_addr learned my addr 172.21.15.135:0/1260719681 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:26.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba16307640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba10143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15305640 1 --2- 172.21.15.135:0/1260719681 >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 0x7fba1013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 -- 172.21.15.135:0/1260719681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 msgr2=0x7fba10143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba10143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 -- 172.21.15.135:0/1260719681 >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 msgr2=0x7fba1013ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 --2- 172.21.15.135:0/1260719681 >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 0x7fba1013ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15b06640 1 -- 172.21.15.135:0/1260719681 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba10073350 con 0x7fba1006d830 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba15305640 1 --2- 172.21.15.135:0/1260719681 >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 0x7fba1013ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.096+0000 7fba16307640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba10143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.097+0000 7fba15b06640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1006d830 0x7fba1006dc10 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fba1013d8d0 tx=0x7fba0802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfd061e1146c546 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.097+0000 7fba14b04640 1 -- 172.21.15.135:0/1260719681 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08038070 con 0x7fba1006d830 2024-05-09T12:30:26.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.097+0000 7fba14b04640 1 -- 172.21.15.135:0/1260719681 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fba08004230 con 0x7fba1006d830 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.097+0000 7fba14b04640 1 -- 172.21.15.135:0/1260719681 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08003610 con 0x7fba1006d830 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 -- 172.21.15.135:0/1260719681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1006d830 msgr2=0x7fba1006dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1006d830 0x7fba1006dc10 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fba1013d8d0 tx=0x7fba0802b7b0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 -- 172.21.15.135:0/1260719681 shutdown_connections 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba10143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 --2- 172.21.15.135:0/1260719681 >> v2:172.21.15.160:3300/0 conn(0x7fba1013a6c0 0x7fba1013ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 --2- 172.21.15.135:0/1260719681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1006d830 0x7fba1006dc10 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 -- 172.21.15.135:0/1260719681 >> 172.21.15.135:0/1260719681 conn(0x7fba10075ec0 msgr2=0x7fba100acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:26.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 -- 172.21.15.135:0/1260719681 shutdown_connections 2024-05-09T12:30:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.098+0000 7fba17d6a640 1 -- 172.21.15.135:0/1260719681 wait complete. 2024-05-09T12:30:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 Processor -- start 2024-05-09T12:30:26.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 -- start start 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba101d2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba101d2590 0x7fba101388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba100a9de0 con 0x7fba1013a6c0 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba1006d1e0 con 0x7fba101d2590 2024-05-09T12:30:26.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba17d6a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba1006f100 con 0x7fba1013b090 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba15b06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba15b06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57532/0 (socket says 172.21.15.135:57532) 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba15b06640 1 -- 172.21.15.135:0/8631146 learned_addr learned my addr 172.21.15.135:0/8631146 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba16307640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba101d2590 0x7fba101388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.099+0000 7fba15305640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba101d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 -- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 msgr2=0x7fba101d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba101d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 -- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba101d2590 msgr2=0x7fba101388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba101d2590 0x7fba101388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 -- 172.21.15.135:0/8631146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba101241d0 con 0x7fba1013a6c0 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba15b06640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fba08000c00 tx=0x7fba080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:26.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08042070 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fba08031730 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba10123440 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08038040 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.100+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba10124d10 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.101+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba10069a50 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.101+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba0803b070 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.102+0000 7fba0e7fc640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 0x7fb9fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.102+0000 7fba15305640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 0x7fb9fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.102+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4054+0+0 (secure 0 0 0) 0x7fba080b8ac0 con 0x7fba1013a6c0 2024-05-09T12:30:26.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.102+0000 7fba15305640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 0x7fb9fc0787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba100a9340 tx=0x7fba04007810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T12:30:26.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.107+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fba080824d0 con 0x7fba1013a6c0 2024-05-09T12:30:26.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.295+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fba1006eee0 con 0x7fba1013a6c0 2024-05-09T12:30:26.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.972+0000 7fba0e7fc640 1 -- 172.21.15.135:0/8631146 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) ==== 169+0+0 (secure 0 0 0) 0x7fba080867d0 con 0x7fba1013a6c0 2024-05-09T12:30:26.974 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-05-09T12:30:26.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.981+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 msgr2=0x7fb9fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:26.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.981+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 0x7fb9fc0787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fba100a9340 tx=0x7fba04007810 comp rx=0 tx=0).stop 2024-05-09T12:30:26.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.981+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 msgr2=0x7fba101d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T12:30:26.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.981+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fba08000c00 tx=0x7fba080046c0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 shutdown_connections 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:6816/185233510,v1:172.21.15.135:6817/185233510] conn(0x7fb9fc076300 0x7fb9fc0787c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba101d2590 0x7fba101388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba1013b090 0x7fba101d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 --2- 172.21.15.135:0/8631146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba1013a6c0 0x7fba101d1b10 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T12:30:26.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 >> 172.21.15.135:0/8631146 conn(0x7fba1006d830 msgr2=0x7fba100a2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T12:30:26.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 shutdown_connections 2024-05-09T12:30:26.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-09T12:30:26.985+0000 7fba17d6a640 1 -- 172.21.15.135:0/8631146 wait complete. 2024-05-09T12:30:27.004 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T12:30:27.005 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T12:30:27.005 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.018 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T12:30:27.018 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T12:30:27.018 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.038 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T12:30:27.038 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T12:30:27.039 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T12:30:27.039 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.120 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T12:30:27.120 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T12:30:27.120 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.199 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T12:30:27.199 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T12:30:27.199 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.273 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T12:30:27.273 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T12:30:27.273 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.341 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T12:30:27.341 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T12:30:27.342 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T12:30:27.342 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.369 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T12:30:27.369 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T12:30:27.369 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.395 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T12:30:27.395 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T12:30:27.396 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T12:30:27.396 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.420 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T12:30:27.420 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T12:30:27.420 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.447 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T12:30:27.447 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T12:30:27.447 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T12:30:27.498 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T12:30:27.498 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T12:30:27.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-09T12:30:27.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:30:27.524 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T12:30:27.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:30:27.980 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T12:30:28.095 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:30:28.096 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T12:30:28.516 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:30:28.516 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T12:30:28.612 INFO:tasks.ceph:Archiving mon data... 2024-05-09T12:30:28.614 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/data/mon.a.tgz 2024-05-09T12:30:28.614 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-09T12:30:28.630 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.XduZkwh3kH 2024-05-09T12:30:28.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XduZkwh3kH 2024-05-09T12:30:28.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.XduZkwh3kH 2024-05-09T12:30:28.857 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.XduZkwh3kH is 392KB 2024-05-09T12:30:28.959 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.XduZkwh3kH 2024-05-09T12:30:28.974 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/data/mon.b.tgz 2024-05-09T12:30:28.974 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-05-09T12:30:28.991 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.Xpb44fDkbg 2024-05-09T12:30:28.992 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Xpb44fDkbg 2024-05-09T12:30:29.142 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.Xpb44fDkbg 2024-05-09T12:30:29.226 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.Xpb44fDkbg is 401KB 2024-05-09T12:30:29.323 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.Xpb44fDkbg 2024-05-09T12:30:29.342 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/data/mon.c.tgz 2024-05-09T12:30:29.342 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-05-09T12:30:29.396 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.VtV4Zj1chb 2024-05-09T12:30:29.396 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VtV4Zj1chb 2024-05-09T12:30:29.533 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.VtV4Zj1chb 2024-05-09T12:30:29.619 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.VtV4Zj1chb is 401KB 2024-05-09T12:30:29.722 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.VtV4Zj1chb 2024-05-09T12:30:29.742 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T12:30:29.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T12:30:29.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T12:30:29.784 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T12:30:29.831 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T12:30:29.862 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T12:30:29.879 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T12:30:29.880 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T12:30:29.881 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi135/crash 2024-05-09T12:30:29.882 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T12:30:29.906 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi160/crash 2024-05-09T12:30:29.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T12:30:29.932 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi188/crash 2024-05-09T12:30:29.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T12:30:29.976 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T12:30:44.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T12:30:44.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T12:30:44.546 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T12:30:44.577 INFO:tasks.ceph:Compressing logs... 2024-05-09T12:30:44.578 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T12:30:44.580 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T12:30:44.589 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T12:30:44.623 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29730.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:gzip/var/log/ceph/ceph-client.admin.29730.log: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29770.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29730.log.gz 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.29770.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29770.log.gz 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29690.log 2024-05-09T12:30:44.624 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29650.log 2024-05-09T12:30:44.625 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.29690.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T12:30:44.625 INFO:teuthology.orchestra.run.smithi160.stderr: 88.3%/var/log/ceph/ceph-client.admin.29650.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.29690.log.gz 2024-05-09T12:30:44.625 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T12:30:44.625 INFO:teuthology.orchestra.run.smithi160.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29650.log.gz 2024-05-09T12:30:44.629 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.b.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26689.log 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.tmp-client.admin.26689.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26689.log.gz 2024-05-09T12:30:44.641 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35101.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35808.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29846.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35101.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29846.log: /var/log/ceph/ceph-client.admin.34824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33394.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29846.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose --/var/log/ceph/ceph.log: 88.6% /var/log/ceph/ceph-client.admin.36667.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34655.log 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36667.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33394.log.gz 2024-05-09T12:30:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33837.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34655.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36144.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33837.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33837.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36144.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36144.log.gz 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34387.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz /var/log/ceph/ceph-client.admin.34489.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-05-09T12:30:44.643 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1%/var/log/ceph/ceph-client.admin.34489.log: -- replaced with /var/log/ceph/ceph-client.admin.34387.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33614.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34303.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34135.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33614.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36606.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34135.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33614.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35227.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34135.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33967.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36606.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34051.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34051.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33967.log.gz 2024-05-09T12:30:44.644 INFO:teuthology.orchestra.run.smithi135.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35227.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34051.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35724.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34488.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34975.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35017.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr: 87.7%/var/log/ceph/ceph-client.admin.34975.log: -- replaced with /var/log/ceph/ceph-client.admin.34488.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33296.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34975.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35017.log: /var/log/ceph/ceph-client.admin.33296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35293.log 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35017.log.gz 2024-05-09T12:30:44.645 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34654.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33296.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35185.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35293.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.35185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36060.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35185.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36356.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36060.log.gz 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.30086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-05-09T12:30:44.646 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8%/var/log/ceph/ceph-client.admin.35934.log: -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33572.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33744.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:gzip 89.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.34487.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33572.log: /var/log/ceph/ceph-client.admin.33744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33572.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34487.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33744.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34487.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35850.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33925.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35059.log 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35850.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-05-09T12:30:44.647 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35850.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30029.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33475.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35892.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35059.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.30029.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30029.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35892.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.34657.log: -- /var/log/ceph/ceph-client.admin.35682.log 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35892.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34765.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-05-09T12:30:44.648 INFO:teuthology.orchestra.run.smithi135.stderr: /var/log/ceph/ceph-client.admin.33879.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35682.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36018.log: --verbose -- /var/log/ceph/ceph-client.admin.33656.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34261.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35976.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34261.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33656.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35766.log 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2024-05-09T12:30:44.649 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35976.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35143.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35766.log: /var/log/ceph/ceph-client.admin.33795.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35766.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36709.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36270.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36564.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36709.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36709.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5/var/log/ceph/ceph-client.admin.36564.log: --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36564.log.gz 2024-05-09T12:30:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34656.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34823.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.33352.log: /var/log/ceph/ceph-client.admin.34656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34823.log: 88.2% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34656.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34823.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: -- /var/log/ceph/ceph-client.admin.34093.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz/var/log/ceph/ceph-client.admin.34093.log: 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-05-09T12:30:44.651 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33700.log 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36438.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.34219.log: -- /var/log/ceph/ceph-client.admin.34933.log 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7%/var/log/ceph/ceph-client.admin.33700.log: -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34933.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33700.log.gz 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.34825.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34933.log.gz 2024-05-09T12:30:44.652 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-05-09T12:30:44.653 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27602.log 2024-05-09T12:30:44.653 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-05-09T12:30:44.653 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_user_test.165740744.47590.log 2024-05-09T12:30:44.654 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.27602.log: /var/log/ceph/ceph-client.admin.47787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47590.log 2024-05-09T12:30:44.654 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.libcephfs_user_test.165740744.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.clear_suidsgid_1095723171.48127.log 2024-05-09T12:30:44.656 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.clear_suidsgid_1095723171.48127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_foo_test.1619811310.47590.log 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.48220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.27218.log 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.libcephfs_foo_test.1619811310.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48127.log 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.0.27218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.libcephfs_foo_test.1619811310.47590.log.gz 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.48127.log: 94.0% -- replaced with /var/log/ceph/ceph-client.libcephfs_user_test.165740744.47590.log.gz 2024-05-09T12:30:44.657 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47869.log 2024-05-09T12:30:44.658 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.48086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_path_test.270977919.47590.log 2024-05-09T12:30:44.658 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.47869.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2024-05-09T12:30:44.659 INFO:teuthology.orchestra.run.smithi188.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.clear_suidsgid_1095723171.48127.log.gz 2024-05-09T12:30:44.662 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.48127.log.gz 2024-05-09T12:30:44.665 INFO:teuthology.orchestra.run.smithi188.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.0.27218.log.gz 2024-05-09T12:30:44.669 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_readonly_test.268408574.47590.log 2024-05-09T12:30:44.669 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.libcephfs_path_test.270977919.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2024-05-09T12:30:44.669 INFO:teuthology.orchestra.run.smithi188.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.47590.log.gz 2024-05-09T12:30:44.670 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.libcephfs_readonly_test.268408574.47590.log: /var/log/ceph/ceph-client.admin.47808.log: 92.1% -- replaced with /var/log/ceph/ceph-client.libcephfs_readonly_test.268408574.47590.log.gz 2024-05-09T12:30:44.671 INFO:teuthology.orchestra.run.smithi188.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2024-05-09T12:30:44.675 INFO:teuthology.orchestra.run.smithi188.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.47869.log.gz 2024-05-09T12:30:44.676 INFO:teuthology.orchestra.run.smithi135.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T12:30:44.676 INFO:teuthology.orchestra.run.smithi188.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.libcephfs_path_test.270977919.47590.log.gz 2024-05-09T12:30:44.852 INFO:teuthology.orchestra.run.smithi160.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T12:30:44.857 INFO:teuthology.orchestra.run.smithi160.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T12:30:45.069 INFO:teuthology.orchestra.run.smithi135.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T12:30:50.423 INFO:teuthology.orchestra.run.smithi188.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.27602.log.gz 2024-05-09T12:31:05.707 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T12:31:10.541 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2024-05-09T12:31:10.543 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-05-09T12:31:10.543 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m25.904s 2024-05-09T12:31:10.544 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m30.628s 2024-05-09T12:31:10.544 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m1.076s 2024-05-09T12:31:17.814 INFO:teuthology.orchestra.run.smithi135.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T12:31:20.278 INFO:teuthology.orchestra.run.smithi135.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T12:31:20.280 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-09T12:31:20.280 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m35.688s 2024-05-09T12:31:20.280 INFO:teuthology.orchestra.run.smithi135.stderr:user 1m27.778s 2024-05-09T12:31:20.281 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m2.632s 2024-05-09T12:31:21.929 INFO:teuthology.orchestra.run.smithi160.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T12:31:24.613 INFO:teuthology.orchestra.run.smithi160.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T12:31:24.615 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-05-09T12:31:24.615 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m40.011s 2024-05-09T12:31:24.615 INFO:teuthology.orchestra.run.smithi160.stderr:user 1m15.462s 2024-05-09T12:31:24.615 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m2.236s 2024-05-09T12:31:24.616 INFO:tasks.ceph:Archiving logs... 2024-05-09T12:31:24.616 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi135/log 2024-05-09T12:31:24.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T12:31:52.635 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi160/log 2024-05-09T12:31:52.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T12:32:05.877 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi188/log 2024-05-09T12:32:05.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T12:32:10.439 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T12:32:10.448 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T12:32:10.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T12:32:10.452 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T12:32:10.454 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T12:32:10.522 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2024-05-09T12:32:10.522 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-09T12:32:10.522 DEBUG:teuthology.orchestra.run.smithi135:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2024-05-09T12:32:10.522 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y remove $d || true 2024-05-09T12:32:10.522 DEBUG:teuthology.orchestra.run.smithi135:> done 2024-05-09T12:32:10.545 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2024-05-09T12:32:10.545 DEBUG:teuthology.orchestra.run.smithi160:> 2024-05-09T12:32:10.545 DEBUG:teuthology.orchestra.run.smithi160:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2024-05-09T12:32:10.545 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y remove $d || true 2024-05-09T12:32:10.545 DEBUG:teuthology.orchestra.run.smithi160:> done 2024-05-09T12:32:10.567 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2024-05-09T12:32:10.568 DEBUG:teuthology.orchestra.run.smithi188:> 2024-05-09T12:32:10.568 DEBUG:teuthology.orchestra.run.smithi188:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2024-05-09T12:32:10.568 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y remove $d || true 2024-05-09T12:32:10.568 DEBUG:teuthology.orchestra.run.smithi188:> done 2024-05-09T12:32:10.861 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 38 M 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 1 Package 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:10.862 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 38 M 2024-05-09T12:32:10.863 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:10.865 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:10.865 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 38 M 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 1 Package 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 38 M 2024-05-09T12:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:10.890 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:10.890 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:10.902 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:10.902 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 38 M 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 1 Package 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 38 M 2024-05-09T12:32:10.903 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:10.905 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:10.906 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:10.930 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:10.930 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:10.988 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:11.010 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:11.011 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.011 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:11.011 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:32:11.011 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.011 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.012 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.034 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:11.039 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.040 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:11.063 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T12:32:11.063 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.064 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2024-05-09T12:32:11.064 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:11.069 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.507 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.594 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:11.760 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:11.800 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 1/1 2024-05-09T12:32:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:11.899 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:11.900 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:12.326 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 210 M 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 @appstream 1.1 M 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 3 Packages 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:12.328 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 211 M 2024-05-09T12:32:12.329 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:12.332 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:12.332 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:12.355 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:12.356 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:12.356 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:12.356 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:12.356 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:12.356 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 210 M 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 @appstream 1.1 M 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 3 Packages 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 211 M 2024-05-09T12:32:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:12.360 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:12.361 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:12.376 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:12.376 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:12.404 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:12.405 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:12.501 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:12.502 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:12.502 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:12.502 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:12.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 210 M 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 @appstream 1.1 M 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 @appstream 195 k 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 3 Packages 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 211 M 2024-05-09T12:32:12.503 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:12.507 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:12.507 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:12.536 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:12.550 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:12.551 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:12.597 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:12.624 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:12.690 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:12.725 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:12.735 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:12.765 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:12.784 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:12.867 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:12.903 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:12.952 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:13.026 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.307 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.307 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:13.307 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:13.327 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.328 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:13.328 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:13.529 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:13.529 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:13.530 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:32:13.530 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:32:13.530 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:13.530 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:13.541 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:13.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 2/3 2024-05-09T12:32:13.564 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:13.565 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 3/3 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-3575.g720f8e95.el9.x86_64 socat-1.7.4.1-5.el9.x86_64 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:13.814 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:14.106 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 0 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 7.3 M 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 18 M 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-1.el9 @epel 692 k 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:14.108 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:14.109 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:14.109 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 6 Packages 2024-05-09T12:32:14.109 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:14.109 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 27 M 2024-05-09T12:32:14.109 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:14.112 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:14.112 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:14.155 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:14.155 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:14.169 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:14.170 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:14.170 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:14.170 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 0 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 7.3 M 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 18 M 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-1.el9 @epel 692 k 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 6 Packages 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 27 M 2024-05-09T12:32:14.171 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:14.174 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:14.174 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:14.217 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:14.218 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:14.358 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:14.410 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:14.426 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 0 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 7.3 M 2024-05-09T12:32:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 18 M 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 @appstream 593 k 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 @crb 49 k 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-1.el9 @epel 692 k 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 6 Packages 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 27 M 2024-05-09T12:32:14.429 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:14.432 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:14.433 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:14.457 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:14.475 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:14.476 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:14.503 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:14.529 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 2/6 2024-05-09T12:32:14.549 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 2/6 2024-05-09T12:32:14.568 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : luarocks-3.9.2-1.el9.noarch 3/6 2024-05-09T12:32:14.614 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : luarocks-3.9.2-1.el9.noarch 3/6 2024-05-09T12:32:14.626 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:14.641 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2024-05-09T12:32:14.652 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:14.654 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.671 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:14.695 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2024-05-09T12:32:14.696 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:14.697 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2024-05-09T12:32:14.720 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:14.722 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:14.755 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:14.815 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.818 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : lua-devel-5.4.4-4.el9.x86_64 2/6 2024-05-09T12:32:14.839 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:14.839 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:14.839 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:32:14.840 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2024-05-09T12:32:14.840 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2024-05-09T12:32:14.840 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:14.842 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:14.882 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : luarocks-3.9.2-1.el9.noarch 3/6 2024-05-09T12:32:14.948 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2024-05-09T12:32:14.972 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:14.973 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:15.025 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 5/6 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2024-05-09T12:32:15.067 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:15.069 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:15.232 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:15.232 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:15.232 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/6 2024-05-09T12:32:15.233 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 3/6 2024-05-09T12:32:15.233 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:15.233 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/6 2024-05-09T12:32:15.304 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:15.305 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:15.305 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/6 2024-05-09T12:32:15.305 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 3/6 2024-05-09T12:32:15.305 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:15.305 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/6 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 6/6 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:15.581 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 6/6 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 1/6 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2/6 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 3/6 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 4/6 2024-05-09T12:32:15.598 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 5/6 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 6/6 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.623 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:32:15.624 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:15.624 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 6/6 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.947 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T12:32:15.948 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T12:32:15.948 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:15.948 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:16.173 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:16.187 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-05-09T12:32:16.187 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:16.187 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-05-09T12:32:16.187 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:16.187 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 22 M 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout:Removing dependent packages: 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 435 k 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 749 k 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 86 M 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 66 M 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 563 k 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 59 M 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.3 M 2024-05-09T12:32:16.188 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 @epel 2.0 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 @appstream 278 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 83 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 694 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 4.7 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.6 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 51 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 138 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 @appstream 68 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @appstream 11 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @appstream 40 k 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2024-05-09T12:32:16.189 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-11.el9 @epel 18 M 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-11.el9 @epel 122 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 425 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-3.el9 @baseos 2.8 M 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-3.el9 @baseos 330 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.6 M 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 19 M 2024-05-09T12:32:16.190 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 @appstream 82 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 @appstream 39 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-11.el9 @epel 2.8 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 @appstream 3.5 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 @crb 2.9 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 187 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 676 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 506 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2024-05-09T12:32:16.191 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-chardet noarch 4.0.0-5.el9 @anaconda 1.4 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.18-3.el9 @appstream 764 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.29.0-1.el9 @epel 1.1 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-idna noarch 2.10-7.el9 @anaconda 459 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2024-05-09T12:32:16.192 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-5.el9 @appstream 1.1 M 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 @appstream 55 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 @appstream 34 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @appstream 25 M 2024-05-09T12:32:16.193 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @appstream 965 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 @appstream 888 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 @baseos 430 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 @appstream 166 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 @appstream 1.4 M 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @appstream 622 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @appstream 1.0 M 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pysocks noarch 1.7.1-12.el9 @anaconda 88 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.194 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 @baseos 392 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 269 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 @appstream 64 M 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 @appstream 99 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-5.el9 @baseos 730 k 2024-05-09T12:32:16.195 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib x86_64 24.02.0-1.el9 @appstream 583 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service x86_64 24.02.0-1.el9 @appstream 65 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs x86_64 1.2.0-1.el9 @appstream 96 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:16.196 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-05-09T12:32:16.197 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 106 Packages 2024-05-09T12:32:16.197 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:16.197 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 626 M 2024-05-09T12:32:16.197 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:16.240 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:16.240 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:16.264 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:16.278 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================== 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================== 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 22 M 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout:Removing dependent packages: 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 435 k 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 749 k 2024-05-09T12:32:16.279 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 86 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 66 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 563 k 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 59 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.3 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 @epel 2.0 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 @appstream 278 k 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 83 M 2024-05-09T12:32:16.280 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 694 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 4.7 M 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.6 M 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 51 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 138 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 @appstream 68 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @appstream 11 M 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @appstream 40 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2024-05-09T12:32:16.281 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 @epel 18 M 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 @epel 122 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 425 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 @baseos 2.8 M 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 @baseos 330 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.6 M 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 19 M 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 @appstream 82 k 2024-05-09T12:32:16.282 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 @appstream 39 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 @epel 2.8 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 @appstream 3.5 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 @crb 2.9 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 187 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 676 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 506 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2024-05-09T12:32:16.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-chardet noarch 4.0.0-5.el9 @anaconda 1.4 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.18-3.el9 @appstream 764 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.29.0-1.el9 @epel 1.1 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-idna noarch 2.10-7.el9 @anaconda 459 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-5.el9 @appstream 1.1 M 2024-05-09T12:32:16.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 @appstream 55 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 @appstream 34 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @appstream 25 M 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @appstream 965 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 @appstream 888 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 @baseos 430 k 2024-05-09T12:32:16.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 @appstream 166 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 @appstream 1.4 M 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @appstream 622 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @appstream 1.0 M 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pysocks noarch 1.7.1-12.el9 @anaconda 88 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 @baseos 392 k 2024-05-09T12:32:16.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 269 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 @appstream 64 M 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 @appstream 99 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 @baseos 730 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 @appstream 583 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 @appstream 65 k 2024-05-09T12:32:16.287 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 @appstream 96 k 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================== 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 106 Packages 2024-05-09T12:32:16.288 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:16.289 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 626 M 2024-05-09T12:32:16.289 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:16.333 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:16.333 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:16.408 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:16.409 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:16.511 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:16.511 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:16.612 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================== 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================== 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 22 M 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout:Removing dependent packages: 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 435 k 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 749 k 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 86 M 2024-05-09T12:32:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 66 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 563 k 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 59 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.3 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 @epel 2.0 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 @appstream 278 k 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 83 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 694 k 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 4.7 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 1.6 M 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 51 k 2024-05-09T12:32:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 138 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 @appstream 68 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @appstream 11 M 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @appstream 40 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 @epel 13 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 @epel 18 M 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 @epel 122 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 425 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 @baseos 2.8 M 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 @baseos 330 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.6 M 2024-05-09T12:32:16.627 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 @appstream 2.0 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 19 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 @appstream 82 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 @appstream 39 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 @epel 2.8 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 @appstream 3.5 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 @crb 2.9 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 @epel 3.9 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 @appstream 27 M 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 187 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 676 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 506 k 2024-05-09T12:32:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 @baseos 1.0 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-chardet noarch 4.0.0-5.el9 @anaconda 1.4 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 @appstream 764 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.29.0-1.el9 @epel 1.1 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 @epel 6.7 M 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 @epel 418 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-idna noarch 2.10-7.el9 @anaconda 459 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2024-05-09T12:32:16.629 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-5.el9 @appstream 1.1 M 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 @appstream 55 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 @appstream 34 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 @appstream 534 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @appstream 60 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @appstream 25 M 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @appstream 965 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 @appstream 888 k 2024-05-09T12:32:16.630 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 @appstream 248 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 @baseos 430 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 @appstream 166 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 @appstream 1.4 M 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @appstream 622 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @appstream 1.0 M 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 @baseos 745 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pysocks noarch 1.7.1-12.el9 @anaconda 88 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 1.1 M 2024-05-09T12:32:16.631 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 @baseos 392 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @appstream 119 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 269 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 @appstream 64 M 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 @appstream 99 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 @baseos 730 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2024-05-09T12:32:16.632 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 @appstream 583 k 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 @appstream 65 k 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 @appstream 96 k 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================== 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 106 Packages 2024-05-09T12:32:16.633 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:16.634 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 626 M 2024-05-09T12:32:16.634 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:16.679 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:16.679 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:16.857 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:16.857 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:17.602 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:17.602 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:17.686 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:17.708 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.708 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:17.709 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:32:17.709 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2024-05-09T12:32:17.709 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2024-05-09T12:32:17.709 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:17.709 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.753 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.761 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:17.761 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 3/106 2024-05-09T12:32:17.812 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:17.833 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2024-05-09T12:32:17.854 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:17.855 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.899 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:17.951 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 3/106 2024-05-09T12:32:17.951 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:17.952 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 5/106 2024-05-09T12:32:17.977 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 6/106 2024-05-09T12:32:17.977 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.014 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.044 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:18.047 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 8/106 2024-05-09T12:32:18.077 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 9/106 2024-05-09T12:32:18.089 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 5/106 2024-05-09T12:32:18.102 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/106 2024-05-09T12:32:18.115 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 6/106 2024-05-09T12:32:18.116 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.123 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/106 2024-05-09T12:32:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:18.153 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.155 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jinja2-2.11.3-5.el9.noarch 12/106 2024-05-09T12:32:18.185 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-requests-2.25.1-8.el9.noarch 13/106 2024-05-09T12:32:18.186 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 8/106 2024-05-09T12:32:18.215 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 9/106 2024-05-09T12:32:18.229 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 1/106 2024-05-09T12:32:18.241 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/106 2024-05-09T12:32:18.250 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:18.250 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.250 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T12:32:18.250 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2024-05-09T12:32:18.251 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2024-05-09T12:32:18.251 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:18.251 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:18.257 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-google-auth-1:2.29.0-1.el9.noarch 14/106 2024-05-09T12:32:18.269 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/106 2024-05-09T12:32:18.290 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 15/106 2024-05-09T12:32:18.303 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jinja2-2.11.3-5.el9.noarch 12/106 2024-05-09T12:32:18.305 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2/106 2024-05-09T12:32:18.330 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 16/106 2024-05-09T12:32:18.333 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-requests-2.25.1-8.el9.noarch 13/106 2024-05-09T12:32:18.359 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 3/106 2024-05-09T12:32:18.359 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:18.365 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 17/106 2024-05-09T12:32:18.372 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-google-auth-1:2.29.0-1.el9.noarch 14/106 2024-05-09T12:32:18.389 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.389 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.389 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:32:18.390 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2024-05-09T12:32:18.390 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2024-05-09T12:32:18.390 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:18.397 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.414 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 15/106 2024-05-09T12:32:18.433 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.445 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 16/106 2024-05-09T12:32:18.452 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.452 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.453 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:32:18.453 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:18.459 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 4/106 2024-05-09T12:32:18.463 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.471 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 17/106 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2024-05-09T12:32:18.496 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:18.503 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.503 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.526 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 5/106 2024-05-09T12:32:18.541 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.543 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 20/106 2024-05-09T12:32:18.548 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 6/106 2024-05-09T12:32:18.548 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.560 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.560 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.560 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:32:18.560 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:18.570 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.573 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 21/106 2024-05-09T12:32:18.585 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 7/106 2024-05-09T12:32:18.611 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:18.618 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 8/106 2024-05-09T12:32:18.633 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-urllib3-1.26.5-5.el9.noarch 22/106 2024-05-09T12:32:18.648 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 9/106 2024-05-09T12:32:18.651 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 20/106 2024-05-09T12:32:18.672 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 23/106 2024-05-09T12:32:18.674 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/106 2024-05-09T12:32:18.680 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 21/106 2024-05-09T12:32:18.697 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/106 2024-05-09T12:32:18.702 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/106 2024-05-09T12:32:18.730 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/106 2024-05-09T12:32:18.740 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-urllib3-1.26.5-5.el9.noarch 22/106 2024-05-09T12:32:18.743 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jinja2-2.11.3-5.el9.noarch 12/106 2024-05-09T12:32:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 26/106 2024-05-09T12:32:18.766 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:18.771 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 23/106 2024-05-09T12:32:18.781 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-requests-2.25.1-8.el9.noarch 13/106 2024-05-09T12:32:18.796 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/106 2024-05-09T12:32:18.799 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:18.820 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-google-auth-1:2.29.0-1.el9.noarch 14/106 2024-05-09T12:32:18.829 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/106 2024-05-09T12:32:18.855 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 15/106 2024-05-09T12:32:18.865 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 26/106 2024-05-09T12:32:18.865 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:18.887 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-grpcio-tools-1.46.7-10.el9.x86_64 16/106 2024-05-09T12:32:18.901 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:18.916 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 28/106 2024-05-09T12:32:18.922 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-grpcio-1.46.7-10.el9.x86_64 17/106 2024-05-09T12:32:18.946 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.946 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:18.946 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T12:32:18.946 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2024-05-09T12:32:18.947 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2024-05-09T12:32:18.947 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:18.954 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:18.978 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 29/106 2024-05-09T12:32:18.990 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 18/106 2024-05-09T12:32:19.009 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:19.009 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.009 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T12:32:19.010 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:19.018 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 28/106 2024-05-09T12:32:19.019 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:19.020 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 30/106 2024-05-09T12:32:19.049 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 31/106 2024-05-09T12:32:19.060 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 19/106 2024-05-09T12:32:19.076 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : protobuf-compiler-3.14.0-13.el9.x86_64 32/106 2024-05-09T12:32:19.078 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 29/106 2024-05-09T12:32:19.100 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 33/106 2024-05-09T12:32:19.101 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 20/106 2024-05-09T12:32:19.120 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 30/106 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.123 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:19.125 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.130 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 21/106 2024-05-09T12:32:19.150 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 31/106 2024-05-09T12:32:19.164 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.176 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : protobuf-compiler-3.14.0-13.el9.x86_64 32/106 2024-05-09T12:32:19.190 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-urllib3-1.26.5-5.el9.noarch 22/106 2024-05-09T12:32:19.200 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 33/106 2024-05-09T12:32:19.202 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 35/106 2024-05-09T12:32:19.224 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.225 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.225 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:32:19.225 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.225 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.225 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:19.227 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.228 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 36/106 2024-05-09T12:32:19.237 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 23/106 2024-05-09T12:32:19.253 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 37/106 2024-05-09T12:32:19.262 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/106 2024-05-09T12:32:19.264 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.280 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 38/106 2024-05-09T12:32:19.294 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 35/106 2024-05-09T12:32:19.295 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/106 2024-05-09T12:32:19.306 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 39/106 2024-05-09T12:32:19.320 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 36/106 2024-05-09T12:32:19.331 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-asyncssh-2.13.2-5.el9.noarch 26/106 2024-05-09T12:32:19.331 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:19.331 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 40/106 2024-05-09T12:32:19.345 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 37/106 2024-05-09T12:32:19.364 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 27/106 2024-05-09T12:32:19.372 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 38/106 2024-05-09T12:32:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 39/106 2024-05-09T12:32:19.404 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 41/106 2024-05-09T12:32:19.431 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 40/106 2024-05-09T12:32:19.452 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 42/106 2024-05-09T12:32:19.480 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 28/106 2024-05-09T12:32:19.484 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 43/106 2024-05-09T12:32:19.505 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 41/106 2024-05-09T12:32:19.513 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/106 2024-05-09T12:32:19.535 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 29/106 2024-05-09T12:32:19.544 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 45/106 2024-05-09T12:32:19.560 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 42/106 2024-05-09T12:32:19.569 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libgfortran-11.4.1-3.el9.x86_64 46/106 2024-05-09T12:32:19.575 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 30/106 2024-05-09T12:32:19.584 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 43/106 2024-05-09T12:32:19.593 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.593 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.593 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:32:19.593 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:19.593 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.613 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/106 2024-05-09T12:32:19.614 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 31/106 2024-05-09T12:32:19.629 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.641 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : protobuf-compiler-3.14.0-13.el9.x86_64 32/106 2024-05-09T12:32:19.643 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 45/106 2024-05-09T12:32:19.653 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 48/106 2024-05-09T12:32:19.665 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 33/106 2024-05-09T12:32:19.668 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libgfortran-11.4.1-3.el9.x86_64 46/106 2024-05-09T12:32:19.680 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 49/106 2024-05-09T12:32:19.688 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.688 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.689 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T12:32:19.689 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.689 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2024-05-09T12:32:19.689 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:19.691 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.693 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.693 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:19.693 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:32:19.694 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:19.694 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.705 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-ply-3.11-14.el9.noarch 50/106 2024-05-09T12:32:19.728 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:19.729 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 34/106 2024-05-09T12:32:19.730 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 51/106 2024-05-09T12:32:19.753 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 48/106 2024-05-09T12:32:19.756 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 52/106 2024-05-09T12:32:19.758 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 35/106 2024-05-09T12:32:19.776 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 36/106 2024-05-09T12:32:19.779 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 49/106 2024-05-09T12:32:19.781 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 53/106 2024-05-09T12:32:19.804 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-ply-3.11-14.el9.noarch 50/106 2024-05-09T12:32:19.807 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 54/106 2024-05-09T12:32:19.809 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 37/106 2024-05-09T12:32:19.829 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 51/106 2024-05-09T12:32:19.836 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 38/106 2024-05-09T12:32:19.846 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 55/106 2024-05-09T12:32:19.855 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 52/106 2024-05-09T12:32:19.862 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 39/106 2024-05-09T12:32:19.881 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 53/106 2024-05-09T12:32:19.883 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-devel-3.9.18-3.el9.x86_64 56/106 2024-05-09T12:32:19.888 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 40/106 2024-05-09T12:32:19.907 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 54/106 2024-05-09T12:32:19.909 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 57/106 2024-05-09T12:32:19.937 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 55/106 2024-05-09T12:32:19.957 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 58/106 2024-05-09T12:32:19.960 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 41/106 2024-05-09T12:32:19.966 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-devel-3.9.18-3.el9.x86_64 56/106 2024-05-09T12:32:19.986 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-idna-2.10-7.el9.noarch 59/106 2024-05-09T12:32:19.991 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 57/106 2024-05-09T12:32:20.014 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pysocks-1.7.1-12.el9.noarch 60/106 2024-05-09T12:32:20.038 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 58/106 2024-05-09T12:32:20.041 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 42/106 2024-05-09T12:32:20.046 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 61/106 2024-05-09T12:32:20.070 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 62/106 2024-05-09T12:32:20.074 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 43/106 2024-05-09T12:32:20.079 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-idna-2.10-7.el9.noarch 59/106 2024-05-09T12:32:20.100 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 63/106 2024-05-09T12:32:20.102 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/106 2024-05-09T12:32:20.105 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pysocks-1.7.1-12.el9.noarch 60/106 2024-05-09T12:32:20.133 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 45/106 2024-05-09T12:32:20.136 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 61/106 2024-05-09T12:32:20.139 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-protobuf-3.14.0-13.el9.noarch 64/106 2024-05-09T12:32:20.157 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libgfortran-11.4.1-3.el9.x86_64 46/106 2024-05-09T12:32:20.160 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 62/106 2024-05-09T12:32:20.167 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:20.183 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T12:32:20.183 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T12:32:20.183 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:20.184 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 63/106 2024-05-09T12:32:20.198 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 66/106 2024-05-09T12:32:20.218 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3575.g720f8 47/106 2024-05-09T12:32:20.221 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-protobuf-3.14.0-13.el9.noarch 64/106 2024-05-09T12:32:20.230 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 67/106 2024-05-09T12:32:20.242 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 48/106 2024-05-09T12:32:20.249 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:20.257 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 68/106 2024-05-09T12:32:20.269 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 49/106 2024-05-09T12:32:20.281 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 66/106 2024-05-09T12:32:20.284 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 69/106 2024-05-09T12:32:20.294 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-ply-3.11-14.el9.noarch 50/106 2024-05-09T12:32:20.312 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 67/106 2024-05-09T12:32:20.315 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 70/106 2024-05-09T12:32:20.319 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 51/106 2024-05-09T12:32:20.339 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 68/106 2024-05-09T12:32:20.345 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 52/106 2024-05-09T12:32:20.345 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 71/106 2024-05-09T12:32:20.366 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 69/106 2024-05-09T12:32:20.370 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 53/106 2024-05-09T12:32:20.385 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 72/106 2024-05-09T12:32:20.396 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 54/106 2024-05-09T12:32:20.398 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 70/106 2024-05-09T12:32:20.410 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 73/106 2024-05-09T12:32:20.427 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 55/106 2024-05-09T12:32:20.427 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 71/106 2024-05-09T12:32:20.435 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 74/106 2024-05-09T12:32:20.456 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-devel-3.9.18-3.el9.x86_64 56/106 2024-05-09T12:32:20.458 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 72/106 2024-05-09T12:32:20.466 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 75/106 2024-05-09T12:32:20.481 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 57/106 2024-05-09T12:32:20.484 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 73/106 2024-05-09T12:32:20.494 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/106 2024-05-09T12:32:20.508 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 74/106 2024-05-09T12:32:20.516 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.516 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2024-05-09T12:32:20.516 INFO:teuthology.orchestra.run.smithi188.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T12:32:20.516 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:20.522 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 58/106 2024-05-09T12:32:20.525 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.525 INFO:teuthology.orchestra.run.smithi188.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2024-05-09T12:32:20.525 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:20.540 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 75/106 2024-05-09T12:32:20.549 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-idna-2.10-7.el9.noarch 59/106 2024-05-09T12:32:20.568 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/106 2024-05-09T12:32:20.578 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pysocks-1.7.1-12.el9.noarch 60/106 2024-05-09T12:32:20.590 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.590 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2024-05-09T12:32:20.590 INFO:teuthology.orchestra.run.smithi160.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T12:32:20.590 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:20.601 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.601 INFO:teuthology.orchestra.run.smithi160.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2024-05-09T12:32:20.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:20.610 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 61/106 2024-05-09T12:32:20.634 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-packaging-20.9-5.el9.noarch 62/106 2024-05-09T12:32:20.653 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.653 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:20.653 INFO:teuthology.orchestra.run.smithi188.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2024-05-09T12:32:20.653 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:20.663 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : grpc-data-1.46.7-10.el9.noarch 63/106 2024-05-09T12:32:20.694 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-protobuf-3.14.0-13.el9.noarch 64/106 2024-05-09T12:32:20.709 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:20.709 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:20.709 INFO:teuthology.orchestra.run.smithi160.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2024-05-09T12:32:20.709 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:20.719 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:20.730 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 79/106 2024-05-09T12:32:20.746 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:20.762 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 66/106 2024-05-09T12:32:20.793 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 67/106 2024-05-09T12:32:20.821 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-chardet-4.0.0-5.el9.noarch 68/106 2024-05-09T12:32:20.829 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:20.847 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 69/106 2024-05-09T12:32:20.850 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:20.857 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : parquet-libs-9.0.0-11.el9.x86_64 81/106 2024-05-09T12:32:20.877 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 79/106 2024-05-09T12:32:20.877 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:20.878 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 70/106 2024-05-09T12:32:20.880 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 82/106 2024-05-09T12:32:20.905 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : qatzip-libs-1.2.0-1.el9.x86_64 83/106 2024-05-09T12:32:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 71/106 2024-05-09T12:32:20.922 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 84/106 2024-05-09T12:32:20.944 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:20.948 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 72/106 2024-05-09T12:32:20.951 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libarrow-doc-9.0.0-11.el9.noarch 85/106 2024-05-09T12:32:20.968 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : parquet-libs-9.0.0-11.el9.x86_64 81/106 2024-05-09T12:32:20.982 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 73/106 2024-05-09T12:32:20.986 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 86/106 2024-05-09T12:32:20.994 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 82/106 2024-05-09T12:32:21.007 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 74/106 2024-05-09T12:32:21.008 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 87/106 2024-05-09T12:32:21.008 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:21.019 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : qatzip-libs-1.2.0-1.el9.x86_64 83/106 2024-05-09T12:32:21.037 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 75/106 2024-05-09T12:32:21.045 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 84/106 2024-05-09T12:32:21.066 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/106 2024-05-09T12:32:21.081 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libarrow-doc-9.0.0-11.el9.noarch 85/106 2024-05-09T12:32:21.088 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:21.088 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2024-05-09T12:32:21.088 INFO:teuthology.orchestra.run.smithi135.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T12:32:21.088 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:21.097 INFO:teuthology.orchestra.run.smithi135.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2024-05-09T12:32:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:21.113 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 86/106 2024-05-09T12:32:21.138 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 87/106 2024-05-09T12:32:21.138 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:21.216 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 77/106 2024-05-09T12:32:21.216 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:21.216 INFO:teuthology.orchestra.run.smithi135.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2024-05-09T12:32:21.216 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:21.441 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 78/106 2024-05-09T12:32:21.468 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 79/106 2024-05-09T12:32:21.468 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:21.551 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 80/106 2024-05-09T12:32:21.575 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : parquet-libs-9.0.0-11.el9.x86_64 81/106 2024-05-09T12:32:21.601 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 82/106 2024-05-09T12:32:21.626 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : qatzip-libs-1.2.0-1.el9.x86_64 83/106 2024-05-09T12:32:21.643 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 84/106 2024-05-09T12:32:21.663 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libarrow-doc-9.0.0-11.el9.noarch 85/106 2024-05-09T12:32:21.704 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 86/106 2024-05-09T12:32:21.728 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 87/106 2024-05-09T12:32:21.729 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:28.746 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:28.746 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-05-09T12:32:28.746 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-05-09T12:32:28.746 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-05-09T12:32:28.747 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-05-09T12:32:28.747 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-05-09T12:32:28.747 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-05-09T12:32:28.747 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-05-09T12:32:28.747 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:28.800 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : qatlib-24.02.0-1.el9.x86_64 89/106 2024-05-09T12:32:28.824 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libarrow-9.0.0-11.el9.x86_64 90/106 2024-05-09T12:32:28.850 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 91/106 2024-05-09T12:32:28.876 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 92/106 2024-05-09T12:32:28.901 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 93/106 2024-05-09T12:32:28.927 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 94/106 2024-05-09T12:32:28.953 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : re2-1:20211101-3.el9.x86_64 95/106 2024-05-09T12:32:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:28.972 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.003 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.028 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 97/106 2024-05-09T12:32:29.054 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 98/106 2024-05-09T12:32:29.079 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 99/106 2024-05-09T12:32:29.104 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-05-09T12:32:29.105 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:29.106 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 100/106 2024-05-09T12:32:29.106 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:29.163 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : qatlib-24.02.0-1.el9.x86_64 89/106 2024-05-09T12:32:29.187 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libarrow-9.0.0-11.el9.x86_64 90/106 2024-05-09T12:32:29.198 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:29.212 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 91/106 2024-05-09T12:32:29.224 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libquadmath-11.4.1-3.el9.x86_64 102/106 2024-05-09T12:32:29.238 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 92/106 2024-05-09T12:32:29.250 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 103/106 2024-05-09T12:32:29.272 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 93/106 2024-05-09T12:32:29.281 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : protobuf-3.14.0-13.el9.x86_64 104/106 2024-05-09T12:32:29.298 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 94/106 2024-05-09T12:32:29.320 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : abseil-cpp-20211102.0-3.el9.x86_64 105/106 2024-05-09T12:32:29.320 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:29.322 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : re2-1:20211101-3.el9.x86_64 95/106 2024-05-09T12:32:29.343 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.343 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.374 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.399 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 97/106 2024-05-09T12:32:29.425 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 98/106 2024-05-09T12:32:29.450 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 99/106 2024-05-09T12:32:29.476 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 100/106 2024-05-09T12:32:29.476 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:29.560 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:29.586 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libquadmath-11.4.1-3.el9.x86_64 102/106 2024-05-09T12:32:29.611 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 103/106 2024-05-09T12:32:29.643 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : protobuf-3.14.0-13.el9.x86_64 104/106 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 88/106 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-09T12:32:29.647 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:29.673 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : abseil-cpp-20211102.0-3.el9.x86_64 105/106 2024-05-09T12:32:29.673 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:29.728 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : qatlib-24.02.0-1.el9.x86_64 89/106 2024-05-09T12:32:29.753 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libarrow-9.0.0-11.el9.x86_64 90/106 2024-05-09T12:32:29.778 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 91/106 2024-05-09T12:32:29.804 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 92/106 2024-05-09T12:32:29.829 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 93/106 2024-05-09T12:32:29.855 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 94/106 2024-05-09T12:32:29.880 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : re2-1:20211101-3.el9.x86_64 95/106 2024-05-09T12:32:29.899 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.899 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.931 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 96/106 2024-05-09T12:32:29.941 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:29.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 1/106 2024-05-09T12:32:29.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 2/106 2024-05-09T12:32:29.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 3/106 2024-05-09T12:32:29.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 4/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 5/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 6/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 7/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 8/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 9/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 10/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 11/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 12/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 13/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 14/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 15/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 16/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 17/106 2024-05-09T12:32:29.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 18/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 19/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 21/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 24/106 2024-05-09T12:32:29.943 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 25/106 2024-05-09T12:32:29.950 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/106 2024-05-09T12:32:29.950 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 27/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 28/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 29/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 30/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 33/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 34/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 35/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 36/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 37/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 38/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/106 2024-05-09T12:32:29.951 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 40/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 41/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 42/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 43/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 44/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 45/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 47/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 48/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 49/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 50/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 51/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 52/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 53/106 2024-05-09T12:32:29.952 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 54/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-idna-2.10-7.el9.noarch 55/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 56/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 57/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 58/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 59/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 60/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 61/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 62/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 63/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 64/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 66/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 67/106 2024-05-09T12:32:29.953 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 69/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 73/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 74/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 75/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 76/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 78/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/106 2024-05-09T12:32:29.954 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pysocks-1.7.1-12.el9.noarch 83/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 84/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 85/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 86/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 90/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 91/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 92/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 94/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 96/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/106 2024-05-09T12:32:29.955 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 98/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 99/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 100/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 101/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 102/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 103/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 104/106 2024-05-09T12:32:29.956 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 105/106 2024-05-09T12:32:29.965 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 97/106 2024-05-09T12:32:29.991 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 98/106 2024-05-09T12:32:30.016 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 99/106 2024-05-09T12:32:30.042 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 100/106 2024-05-09T12:32:30.042 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:30.126 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 101/106 2024-05-09T12:32:30.152 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libquadmath-11.4.1-3.el9.x86_64 102/106 2024-05-09T12:32:30.178 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 103/106 2024-05-09T12:32:30.209 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : protobuf-3.14.0-13.el9.x86_64 104/106 2024-05-09T12:32:30.239 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : abseil-cpp-20211102.0-3.el9.x86_64 105/106 2024-05-09T12:32:30.239 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 1/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 2/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 3/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 4/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 5/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 6/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 7/106 2024-05-09T12:32:30.274 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 8/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 9/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 10/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 11/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 12/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 13/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 14/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 15/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 16/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 17/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 18/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 19/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 21/106 2024-05-09T12:32:30.275 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 24/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 25/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 27/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 28/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 29/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 30/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 33/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 34/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 35/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 36/106 2024-05-09T12:32:30.276 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 37/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 38/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 40/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 41/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 42/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 43/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 44/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 45/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 47/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 48/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 49/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 50/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 51/106 2024-05-09T12:32:30.277 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 52/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 53/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 54/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-idna-2.10-7.el9.noarch 55/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 56/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 57/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 58/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 59/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 60/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 61/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 62/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 63/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 64/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:30.278 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 66/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 67/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 69/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 73/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 74/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 75/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 76/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 78/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/106 2024-05-09T12:32:30.279 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pysocks-1.7.1-12.el9.noarch 83/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 84/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 85/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 86/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 90/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 91/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 92/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 94/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/106 2024-05-09T12:32:30.280 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 96/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 98/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 99/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 100/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 101/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 102/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 103/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 104/106 2024-05-09T12:32:30.281 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 105/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 106/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 1/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 2/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 3/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 4/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95. 5/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3575.g720f8 6/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 7/106 2024-05-09T12:32:30.871 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noa 8/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.n 9/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3575.g720 10/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el 11/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 12/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 13/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.e 14/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 15/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 16/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 17/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 18/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 19/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 21/106 2024-05-09T12:32:30.872 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 24/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 25/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 27/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 28/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86 29/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 30/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 31/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 33/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 34/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 35/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 36/106 2024-05-09T12:32:30.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 37/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 38/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 40/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 41/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el 42/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-3575.g720f8e95.el9. 43/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_6 44/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 45/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-chardet-4.0.0-5.el9.noarch 47/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 48/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 49/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 50/106 2024-05-09T12:32:30.874 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 51/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 52/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 53/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 54/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-idna-2.10-7.el9.noarch 55/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 56/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 57/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 58/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 59/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 60/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 61/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 62/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 63/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 64/106 2024-05-09T12:32:30.875 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 65/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 66/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 67/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 68/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 69/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 73/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 74/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 75/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 76/106 2024-05-09T12:32:30.876 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 78/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pysocks-1.7.1-12.el9.noarch 83/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 84/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 85/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 86/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 89/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 90/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 91/106 2024-05-09T12:32:30.877 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 92/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 94/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 96/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 98/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 99/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 100/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 101/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 102/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 103/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 104/106 2024-05-09T12:32:30.878 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 105/106 2024-05-09T12:32:31.863 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 106/106 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.864 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:32:31.865 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:32:31.866 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-chardet-4.0.0-5.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:32:31.867 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-idna-2.10-7.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:32:31.868 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:32:31.869 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pysocks-1.7.1-12.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:32:31.870 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:32:31.871 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 106/106 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:31.872 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.873 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:32:31.874 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.875 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-chardet-4.0.0-5.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-idna-2.10-7.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:32:31.876 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:32:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pysocks-1.7.1-12.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:32:31.878 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:32:31.879 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:31.880 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:32.478 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 770 k 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 1 Package 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 770 k 2024-05-09T12:32:32.479 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:32.482 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:32.482 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:32.482 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 770 k 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 1 Package 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 770 k 2024-05-09T12:32:32.483 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:32.484 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:32.484 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:32.485 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:32.485 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:32.486 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:32.487 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:32.543 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:32.543 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:32.545 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:32.545 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:32.589 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 106/106 2024-05-09T12:32:32.589 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:32.589 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:32.589 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T12:32:32.591 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.592 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-chardet-4.0.0-5.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-idna-2.10-7.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T12:32:32.593 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T12:32:32.594 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pysocks-1.7.1-12.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T12:32:32.595 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T12:32:32.596 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T12:32:32.597 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T12:32:32.597 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T12:32:32.597 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:32.598 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T12:32:32.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:32.598 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-3575.g720f8e95.el9 @ceph-noarch 770 k 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:33.196 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:33.197 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 1 Package 2024-05-09T12:32:33.197 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:33.197 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 770 k 2024-05-09T12:32:33.197 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:33.198 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:33.198 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:33.199 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:33.200 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:33.251 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:33.251 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:33.293 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:33.399 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:33.601 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:33.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:33.602 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:33.956 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-immutable-object-cache 2024-05-09T12:32:33.956 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:33.960 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:33.962 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:33.962 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:34.038 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-immutable-object-cache 2024-05-09T12:32:34.038 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:34.043 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:34.044 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:34.044 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:34.107 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:34.286 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-mgr 2024-05-09T12:32:34.286 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:34.291 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:34.292 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:34.292 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 1/1 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-3575.g720f8e95.el9.noarch 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:34.310 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:34.393 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-mgr 2024-05-09T12:32:34.394 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:34.398 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:34.400 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:34.400 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:34.621 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-mgr-dashboard 2024-05-09T12:32:34.622 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:34.626 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:34.628 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:34.628 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:34.729 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-mgr-dashboard 2024-05-09T12:32:34.729 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:34.734 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:34.735 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:34.735 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:34.767 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-immutable-object-cache 2024-05-09T12:32:34.767 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:34.772 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:34.773 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:34.774 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:34.949 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-05-09T12:32:34.949 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:34.954 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:34.955 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:34.955 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:35.052 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-05-09T12:32:35.052 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:35.056 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:35.058 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:35.058 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:35.128 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr 2024-05-09T12:32:35.128 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:35.133 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:35.134 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:35.134 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:35.267 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-mgr-rook 2024-05-09T12:32:35.268 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:35.273 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:35.274 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:35.274 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:35.372 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-mgr-rook 2024-05-09T12:32:35.372 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:35.377 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:35.378 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:35.378 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:35.467 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-dashboard 2024-05-09T12:32:35.467 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:35.472 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:35.473 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:35.473 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:35.593 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-mgr-cephadm 2024-05-09T12:32:35.593 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:35.598 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:35.599 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:35.599 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:35.690 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-mgr-cephadm 2024-05-09T12:32:35.690 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:35.695 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:35.696 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:35.696 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:35.790 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-05-09T12:32:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:35.795 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:35.796 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:35.797 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:35.941 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.6 M 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:35.942 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 @baseos 215 k 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 2 Packages 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 2.8 M 2024-05-09T12:32:35.943 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:35.945 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:35.945 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:35.973 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:35.973 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:36.047 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:36.047 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.6 M 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 @baseos 215 k 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 2 Packages 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 2.8 M 2024-05-09T12:32:36.048 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:36.051 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:36.051 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:36.063 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:36.081 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:36.081 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:36.120 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-rook 2024-05-09T12:32:36.120 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:36.125 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:36.126 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:36.126 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:36.148 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:36.171 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:36.202 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.257 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:36.312 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.454 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-mgr-cephadm 2024-05-09T12:32:36.454 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:36.458 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:36.460 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:36.460 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.530 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:36.645 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.645 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:36.717 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.717 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:36.717 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:36.717 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:32:36.717 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:36.718 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:36.814 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.6 M 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 @baseos 215 k 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:36.815 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 2 Packages 2024-05-09T12:32:36.816 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:36.816 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 2.8 M 2024-05-09T12:32:36.816 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:36.818 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:36.818 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:36.845 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:36.846 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:36.867 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:36.927 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:37.010 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:37.064 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:37.233 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: ceph-volume 2024-05-09T12:32:37.234 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:37.238 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:37.240 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:37.240 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:37.347 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: ceph-volume 2024-05-09T12:32:37.348 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:37.352 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:37.354 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:37.354 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:37.425 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:37.425 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 1/2 2024-05-09T12:32:37.619 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:37.620 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:37.620 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 456 k 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Removing dependent packages: 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 142 k 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.1 M 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 3 Packages 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 2.7 M 2024-05-09T12:32:37.621 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:37.624 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:37.624 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:37.634 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:37.654 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:37.655 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:37.707 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 456 k 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:Removing dependent packages: 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 142 k 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.1 M 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:37.708 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:37.709 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 3 Packages 2024-05-09T12:32:37.709 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:37.709 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 2.7 M 2024-05-09T12:32:37.709 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:37.711 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:37.711 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:37.741 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:37.765 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:37.829 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:37.829 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:37.878 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:37.962 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:37.962 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:37.988 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:38.046 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.105 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:38.161 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.177 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: ceph-volume 2024-05-09T12:32:38.177 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:38.182 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:38.184 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:38.184 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:38.381 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.381 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:38.382 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:38.502 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:38.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:38.556 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:38.557 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:38.557 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-05-09T12:32:38.557 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 456 k 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Removing dependent packages: 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 142 k 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 2.1 M 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 3 Packages 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 2.7 M 2024-05-09T12:32:38.558 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:38.560 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:38.561 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:38.590 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:38.590 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.634 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:38.635 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:38.703 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:38.724 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:38.788 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:38.788 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:38.923 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:39.012 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:39.149 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: libcephfs2 2024-05-09T12:32:39.150 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:39.154 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:39.155 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:39.156 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:39.237 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: libcephfs2 2024-05-09T12:32:39.238 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:39.242 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:39.244 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:39.244 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:39.362 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:39.362 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 1/3 2024-05-09T12:32:39.362 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/3 2024-05-09T12:32:39.469 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: libcephfs-devel 2024-05-09T12:32:39.470 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:39.570 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: libcephfs-devel 2024-05-09T12:32:39.570 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:39.575 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:39.576 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:39.576 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:39.576 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 3/3 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:39.577 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:39.837 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:39.839 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:39.839 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:Removing: 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 12 M 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:Removing dependent packages: 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: qemu-kvm-block-rbd x86_64 17:9.0.0-1.el9 @appstream 41 k 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 231 k 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 494 k 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:Removing unused dependencies: 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-05-09T12:32:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-05-09T12:32:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:Remove 8 Packages 2024-05-09T12:32:39.841 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:Freed space: 32 M 2024-05-09T12:32:39.841 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-05-09T12:32:39.844 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-05-09T12:32:39.844 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-05-09T12:32:39.874 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-05-09T12:32:39.875 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-05-09T12:32:39.940 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout:Removing: 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 12 M 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout:Removing dependent packages: 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout: qemu-kvm-block-rbd x86_64 17:9.0.0-1.el9 @appstream 41 k 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 231 k 2024-05-09T12:32:39.942 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 494 k 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:Removing unused dependencies: 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:Remove 8 Packages 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:Freed space: 32 M 2024-05-09T12:32:39.943 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-09T12:32:39.947 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-09T12:32:39.947 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-09T12:32:39.978 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-09T12:32:39.978 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-09T12:32:40.024 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-05-09T12:32:40.095 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: libcephfs2 2024-05-09T12:32:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:40.100 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:40.101 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:40.102 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:40.103 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/8 2024-05-09T12:32:40.121 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-09T12:32:40.145 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:40.172 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 3/8 2024-05-09T12:32:40.172 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:40.200 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/8 2024-05-09T12:32:40.225 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 3/8 2024-05-09T12:32:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:40.257 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:40.257 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:40.257 INFO:teuthology.orchestra.run.smithi188.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2024-05-09T12:32:40.257 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:40.337 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:40.337 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:40.338 INFO:teuthology.orchestra.run.smithi160.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2024-05-09T12:32:40.338 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:40.358 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:40.400 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2024-05-09T12:32:40.422 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:40.425 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2024-05-09T12:32:40.441 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: libcephfs-devel 2024-05-09T12:32:40.441 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:40.446 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:40.447 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:40.447 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:40.455 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2024-05-09T12:32:40.479 INFO:teuthology.orchestra.run.smithi188.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:40.480 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2024-05-09T12:32:40.534 INFO:teuthology.orchestra.run.smithi160.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:40.810 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:40.812 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:40.812 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-09T12:32:40.812 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout:Removing: 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 12 M 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout:Removing dependent packages: 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: qemu-kvm-block-rbd x86_64 17:9.0.0-1.el9 @appstream 41 k 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 231 k 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 494 k 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout:Removing unused dependencies: 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 @appstream 383 k 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-3575.g720f8e95.el9 @ceph 13 M 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 @appstream 1.0 M 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:40.813 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-09T12:32:40.814 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-05-09T12:32:40.814 INFO:teuthology.orchestra.run.smithi135.stdout:Remove 8 Packages 2024-05-09T12:32:40.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:40.814 INFO:teuthology.orchestra.run.smithi135.stdout:Freed space: 32 M 2024-05-09T12:32:40.814 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-09T12:32:40.817 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-09T12:32:40.817 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-09T12:32:40.848 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-09T12:32:40.848 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-09T12:32:40.938 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:40.938 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 3/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 5/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 6/8 2024-05-09T12:32:40.939 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 7/8 2024-05-09T12:32:40.941 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:40.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2024-05-09T12:32:40.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:40.941 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 3/8 2024-05-09T12:32:40.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2024-05-09T12:32:40.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 5/8 2024-05-09T12:32:40.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 6/8 2024-05-09T12:32:40.942 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 7/8 2024-05-09T12:32:40.990 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-09T12:32:41.076 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 1/8 2024-05-09T12:32:41.102 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:41.129 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 3/8 2024-05-09T12:32:41.129 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:41.214 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 4/8 2024-05-09T12:32:41.214 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:41.214 INFO:teuthology.orchestra.run.smithi135.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2024-05-09T12:32:41.214 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:41.216 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2024-05-09T12:32:41.216 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:41.216 INFO:teuthology.orchestra.run.smithi160.stdout:Removed: 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-09T12:32:41.217 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:41.261 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2024-05-09T12:32:41.261 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:41.261 INFO:teuthology.orchestra.run.smithi188.stdout:Removed: 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-05-09T12:32:41.262 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:41.299 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 5/8 2024-05-09T12:32:41.332 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2024-05-09T12:32:41.358 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2024-05-09T12:32:41.411 INFO:teuthology.orchestra.run.smithi135.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:41.689 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: librbd1 2024-05-09T12:32:41.689 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:41.694 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:41.696 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:41.696 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 3/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 5/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 6/8 2024-05-09T12:32:41.792 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 7/8 2024-05-09T12:32:41.805 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: librbd1 2024-05-09T12:32:41.806 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:41.810 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:41.811 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:41.811 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:42.039 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: python3-rados 2024-05-09T12:32:42.039 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:42.044 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:42.045 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:42.045 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout:Removed: 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: qemu-kvm-block-rbd-17:9.0.0-1.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-3575.g720f8e95.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-09T12:32:42.069 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:42.137 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: python3-rados 2024-05-09T12:32:42.137 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:42.142 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:42.143 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:42.143 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:42.385 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: python3-rgw 2024-05-09T12:32:42.385 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:42.390 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:42.391 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:42.391 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:42.490 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: python3-rgw 2024-05-09T12:32:42.491 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:42.495 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:42.496 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:42.497 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:42.586 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: librbd1 2024-05-09T12:32:42.586 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:42.591 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:42.592 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:42.592 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:42.722 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: python3-cephfs 2024-05-09T12:32:42.722 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:42.727 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:42.728 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:42.728 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:42.815 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: python3-cephfs 2024-05-09T12:32:42.816 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:42.820 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:42.821 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:42.821 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:42.926 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: python3-rados 2024-05-09T12:32:42.926 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:42.931 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:42.932 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:42.932 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:43.049 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: python3-rbd 2024-05-09T12:32:43.049 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:43.054 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:43.055 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:43.055 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:43.133 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: python3-rbd 2024-05-09T12:32:43.133 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:43.137 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:43.139 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:43.139 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:43.262 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: python3-rgw 2024-05-09T12:32:43.263 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:43.267 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:43.268 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:43.268 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:43.372 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: rbd-fuse 2024-05-09T12:32:43.372 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:43.376 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:43.378 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:43.378 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:43.448 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: rbd-fuse 2024-05-09T12:32:43.448 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:43.453 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:43.454 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:43.454 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:43.605 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: python3-cephfs 2024-05-09T12:32:43.606 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:43.610 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:43.611 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:43.611 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:43.690 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: rbd-mirror 2024-05-09T12:32:43.690 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:43.695 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:43.696 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:43.696 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:43.766 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: rbd-mirror 2024-05-09T12:32:43.766 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:43.771 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:43.772 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:43.772 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:43.929 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: python3-rbd 2024-05-09T12:32:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:43.934 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:43.936 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:43.936 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:44.017 INFO:teuthology.orchestra.run.smithi160.stdout:No match for argument: rbd-nbd 2024-05-09T12:32:44.018 INFO:teuthology.orchestra.run.smithi160.stderr:No packages marked for removal. 2024-05-09T12:32:44.022 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-09T12:32:44.023 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-09T12:32:44.023 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-09T12:32:44.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-05-09T12:32:44.078 INFO:teuthology.orchestra.run.smithi188.stdout:No match for argument: rbd-nbd 2024-05-09T12:32:44.079 INFO:teuthology.orchestra.run.smithi188.stderr:No packages marked for removal. 2024-05-09T12:32:44.083 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-05-09T12:32:44.085 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-05-09T12:32:44.085 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-05-09T12:32:44.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-05-09T12:32:44.254 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: rbd-fuse 2024-05-09T12:32:44.254 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:44.259 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:44.260 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:44.260 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:44.267 INFO:teuthology.orchestra.run.smithi160.stdout:60 files removed 2024-05-09T12:32:44.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:44.322 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean expire-cache 2024-05-09T12:32:44.323 INFO:teuthology.orchestra.run.smithi188.stdout:60 files removed 2024-05-09T12:32:44.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:44.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean expire-cache 2024-05-09T12:32:44.531 INFO:teuthology.orchestra.run.smithi160.stdout:Cache was expired 2024-05-09T12:32:44.533 INFO:teuthology.orchestra.run.smithi160.stdout:0 files removed 2024-05-09T12:32:44.559 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:44.577 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: rbd-mirror 2024-05-09T12:32:44.577 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:44.582 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:44.583 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:44.583 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:44.586 INFO:teuthology.orchestra.run.smithi188.stdout:Cache was expired 2024-05-09T12:32:44.586 INFO:teuthology.orchestra.run.smithi188.stdout:0 files removed 2024-05-09T12:32:44.613 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:44.903 INFO:teuthology.orchestra.run.smithi135.stdout:No match for argument: rbd-nbd 2024-05-09T12:32:44.903 INFO:teuthology.orchestra.run.smithi135.stderr:No packages marked for removal. 2024-05-09T12:32:44.908 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-09T12:32:44.909 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-09T12:32:44.909 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-09T12:32:44.965 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-09T12:32:45.152 INFO:teuthology.orchestra.run.smithi135.stdout:60 files removed 2024-05-09T12:32:45.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:45.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean expire-cache 2024-05-09T12:32:45.415 INFO:teuthology.orchestra.run.smithi135.stdout:Cache was expired 2024-05-09T12:32:45.415 INFO:teuthology.orchestra.run.smithi135.stdout:0 files removed 2024-05-09T12:32:45.442 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:45.442 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:32:45.442 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:32:45.442 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi188.front.sepia.ceph.com 2024-05-09T12:32:45.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:45.443 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:45.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-05-09T12:32:45.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:32:45.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:32:45.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2024-05-09T12:32:45.532 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:45.536 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:45.540 DEBUG:teuthology.parallel:result is None 2024-05-09T12:32:45.541 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T12:32:45.550 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T12:32:45.553 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:32:45.576 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:32:45.579 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T12:32:45.587 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:32:45.591 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +899us[ +895us] +/- 66ms 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1109us[-1113us] +/- 63ms 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +361us[ +361us] +/- 92ms 2024-05-09T12:32:45.593 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:32:45.596 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +844us[ +843us] +/- 66ms 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1123us[-1123us] +/- 63ms 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +339us[ +339us] +/- 92ms 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:32:45.597 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +863us[ +867us] +/- 66ms 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1115us[-1111us] +/- 63ms 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +358us[ +362us] +/- 92ms 2024-05-09T12:32:45.602 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T12:32:45.603 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T12:32:45.612 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T12:32:45.612 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T12:32:45.622 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T12:32:45.696 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T12:32:45.758 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T12:32:45.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:32:45.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:45.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:32:45.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:45.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T12:32:45.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:45.907 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T12:32:45.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T12:32:45.955 INFO:teuthology.task.internal:Duration was 1178.924651 seconds 2024-05-09T12:32:45.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T12:32:45.988 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T12:32:45.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T12:32:45.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T12:32:45.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T12:32:46.027 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:32:46.030 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:32:46.034 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T12:32:46.327 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T12:32:46.328 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-09T12:32:46.328 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T12:32:46.348 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-05-09T12:32:46.348 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T12:32:46.392 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-05-09T12:32:46.393 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T12:32:46.426 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T12:32:46.426 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T12:32:46.429 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T12:32:46.435 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T12:32:46.494 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T12:32:46.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T12:32:46.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T12:32:46.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T12:32:46.636 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T12:32:46.646 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T12:32:46.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T12:32:46.672 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T12:32:46.698 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T12:32:46.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T12:32:46.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.736 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.756 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-09T12:32:46.762 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-05-09T12:32:46.787 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-05-09T12:32:46.800 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:46.835 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:46.850 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T12:32:46.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T12:32:46.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T12:32:46.875 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T12:32:46.876 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi135 2024-05-09T12:32:46.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T12:32:46.913 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi160 2024-05-09T12:32:46.913 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T12:32:46.946 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-09_05:00:13-smoke-main-distro-default-smithi/7699569/remote/smithi188 2024-05-09T12:32:46.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T12:32:46.979 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T12:32:46.979 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T12:32:46.982 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T12:32:46.984 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T12:32:47.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T12:32:47.042 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T12:32:47.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T12:32:47.054 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T12:32:47.054 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T12:32:47.057 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T12:32:47.060 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T12:32:47.069 INFO:teuthology.orchestra.run.smithi135.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 12:32 /home/ubuntu/cephtest 2024-05-09T12:32:47.073 INFO:teuthology.orchestra.run.smithi160.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 12:32 /home/ubuntu/cephtest 2024-05-09T12:32:47.085 INFO:teuthology.orchestra.run.smithi188.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 12:32 /home/ubuntu/cephtest 2024-05-09T12:32:47.086 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T12:32:47.097 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T12:32:47.148 INFO:teuthology.run:Summary data: description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} duration: 1178.9246513843536 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-05-09T12:32:47.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T12:32:47.235 INFO:teuthology.run:pass